Saurabh Misra
|
47ff3ada3c
|
fix
|
2024-12-31 12:26:12 -08:00 |
|
Saurabh Misra
|
52667b0eb6
|
fix the env vars
|
2024-12-31 12:09:32 -08:00 |
|
Saurabh Misra
|
72828a0987
|
Use local aiservice
|
2024-12-31 12:04:46 -08:00 |
|
Saurabh Misra
|
6b39923939
|
cleanup
|
2024-12-20 13:37:16 -08:00 |
|
Saurabh Misra
|
e2cea11154
|
remove unnecessary things
|
2024-12-20 13:36:39 -08:00 |
|
Alvin Ryanputra
|
1acb5c2848
|
added env variables
|
2024-12-19 14:42:16 -08:00 |
|
Alvin Ryanputra
|
a4f0dcb8a7
|
trying the changes again
|
2024-12-19 14:41:00 -08:00 |
|
Alvin Ryanputra
|
ff78b1374e
|
revert to previous version to see if end-to-end bubblesort-pytest-no-git works
|
2024-12-19 14:37:16 -08:00 |
|
Alvin Ryanputra
|
72b49c50ff
|
minor fixes
|
2024-12-19 14:04:44 -08:00 |
|
Alvin Ryanputra
|
30bf7e1af9
|
added CODEFLASH_AIS_SERVER: local
|
2024-12-19 11:44:55 -08:00 |
|
Alvin Ryanputra
|
692377a349
|
logs not captured properly
|
2024-12-19 11:36:34 -08:00 |
|
Alvin Ryanputra
|
b568b00ece
|
logs not captured properly
|
2024-12-19 11:26:07 -08:00 |
|
Alvin Ryanputra
|
52baa127ff
|
logs not captured properly
|
2024-12-19 11:12:40 -08:00 |
|
Alvin Ryanputra
|
a0ee530b6c
|
end to end tests now run with local aiserver
|
2024-12-19 10:43:35 -08:00 |
|
Alvin Ryanputra
|
7bcda28bc7
|
end to end changes
|
2024-12-19 10:22:07 -08:00 |
|
Alvin Ryanputra
|
7713fcdd6d
|
added black install for github workflow, since my-best-repo is configured to use it here
|
2024-12-18 16:55:05 -08:00 |
|
Alvin Ryanputra
|
184b567df0
|
added black install for github workflow, since my-best-repo is configured to use it here
|
2024-12-18 16:50:18 -08:00 |
|
Alvin Ryanputra
|
6252fbe372
|
fixes
|
2024-12-18 16:20:02 -08:00 |
|
Alvin Ryanputra
|
001bd3f729
|
api key issue
|
2024-12-18 16:13:36 -08:00 |
|
Alvin Ryanputra
|
951248b55a
|
see logs
|
2024-12-18 16:10:09 -08:00 |
|
Alvin Ryanputra
|
306dc760c2
|
see logs
|
2024-12-18 16:01:31 -08:00 |
|
Alvin Ryanputra
|
91e65a8154
|
fixes
|
2024-12-18 15:52:42 -08:00 |
|
Alvin Ryanputra
|
ed47fe0130
|
fixes
|
2024-12-18 15:50:00 -08:00 |
|
Alvin Ryanputra
|
e627c95643
|
env variable
|
2024-12-18 15:46:14 -08:00 |
|
Alvin Ryanputra
|
1594f13b61
|
fixes
|
2024-12-18 15:45:12 -08:00 |
|
Alvin Ryanputra
|
e591b835d9
|
fixes
|
2024-12-18 15:42:16 -08:00 |
|
Alvin Ryanputra
|
e898ab36bb
|
fixes
|
2024-12-18 15:40:36 -08:00 |
|
Alvin Ryanputra
|
ae7813f7c5
|
fixes
|
2024-12-18 15:28:20 -08:00 |
|
Alvin Ryanputra
|
ad201b7aa5
|
end to end test that spins up a local aiserver
|
2024-12-18 15:24:19 -08:00 |
|
Saurabh Misra
|
d37999da57
|
fix unit tests
|
2024-12-09 12:30:39 -08:00 |
|
Saurabh Misra
|
625349fdd5
|
fix unit tests
|
2024-12-09 12:26:40 -08:00 |
|
Saurabh Misra
|
09d28b3803
|
add codecov integration
|
2024-12-09 12:17:16 -08:00 |
|
Saurabh Misra
|
063417f971
|
Try out if we should cancel previous workflows when new commits are added to a PR
|
2024-12-06 11:57:59 -08:00 |
|
Alvin Ryanputra
|
d33fbec85e
|
removed pytest, only have pytest-no-git instead
|
2024-11-26 19:21:06 -05:00 |
|
Alvin Ryanputra
|
8fa0980a94
|
Merge branch 'main' into cli_set_remote
# Conflicts:
# cli/codeflash/optimization/optimizer.py
# cli/codeflash/result/create_pr.py
|
2024-11-26 19:17:57 -05:00 |
|
Sarthak Agarwal
|
3c3e16d657
|
Retry added to E2E tests GA workflows (#1272)
### **User description**
For more granular control and visibility added retries in py code and we
can run test it in local as well with retries default values
Other option was: https://github.com/marketplace/actions/retry-step
(Suggested by @KRRT7)
closes
https://linear.app/codeflash-ai/issue/CF-446/retry-logic-for-e2e-tests-when-we-raise-a-pr
___
### **PR Type**
enhancement, tests
___
### **Description**
- Added retry logic to end-to-end test scripts with configurable retry
count and delay.
- Replaced assertions with error handling and detailed error messages
for better reliability.
- Enhanced test output to provide clearer information on test success
and failure.
- Updated GitHub workflows to include environment variables for retry
configuration.
___
### **Changes walkthrough** 📝
<table><thead><tr><th></th><th align="left">Relevant
files</th></tr></thead><tbody><tr><td><strong>Enhancement</strong></td><td><details><summary>5
files</summary><table>
<tr>
<td>
<details>
<summary><strong>end_to_end_test_bubblesort_pytest.py</strong><dd><code>Add
retry logic and improve test output handling</code>
</dd></summary>
<hr>
cli/tests/scripts/end_to_end_test_bubblesort_pytest.py
<li>Added retry logic with configurable retries and delay.<br> <li>
Replaced assertions with conditional checks and error messages.<br> <li>
Improved test output with detailed success and failure messages.<br>
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-1675bebf1c1271349eaf2d4857bcb485174ca072b5e7134b145dfc09f22eaf56">+54/-8</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end_to_end_test_bubblesort_unittest.py</strong><dd><code>Implement
retry and enhance test output clarity</code>
</dd></summary>
<hr>
cli/tests/scripts/end_to_end_test_bubblesort_unittest.py
<li>Implemented retry mechanism with environment variable
configuration.<br> <li> Replaced assertions with error handling and
messages.<br> <li> Enhanced test output for better clarity on success
and failure.<br>
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-a8b1dd57a38145173741c89fd14c4afa4be3109cdf5cef7bb22eb6f728fe6b83">+53/-9</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end_to_end_test_futurehouse.py</strong><dd><code>Introduce
retry logic and improve test robustness</code>
</dd></summary>
<hr>
cli/tests/scripts/end_to_end_test_futurehouse.py
<li>Introduced retry logic with configurable parameters.<br> <li>
Replaced assertions with error handling for robustness.<br> <li>
Improved test output for better understanding of results.<br>
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-2889d481bb756712ba25d95e2798b806a58af3a45be003fcddfc016b3d6a6b89">+58/-8</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end_to_end_test_topological_sort.py</strong><dd><code>Add
retry functionality and enhance test reporting</code>
</dd></summary>
<hr>
cli/tests/scripts/end_to_end_test_topological_sort.py
<li>Added retry functionality with environment-based configuration.<br>
<li> Replaced assertions with error handling and detailed messages.<br>
<li> Enhanced test output for clearer success and failure reporting.<br>
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-ea4663c419298d6a5acfba94786b47dc1d76559e41f21a5b33de98cfe6566548">+60/-8</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end_to_end_test_tracer_replay.py</strong><dd><code>Implement
retry logic and improve test reliability</code>
</dd></summary>
<hr>
cli/tests/scripts/end_to_end_test_tracer_replay.py
<li>Implemented retry logic with configurable settings.<br> <li>
Replaced assertions with error handling for better reliability.<br> <li>
Improved test output with detailed success and failure information.<br>
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-3adb754bd59c9beebe81442cfb3ed44e0dc7a7bc0e14aae8aaeb992dccac9332">+96/-18</a>
</td>
</tr>
</table></details></td></tr><tr><td><strong>Configuration
changes</strong></td><td><details><summary>5 files</summary><table>
<tr>
<td>
<details>
<summary><strong>end-to-end-test-bubblesort-pytest.yaml</strong><dd><code>Add
retry configuration to workflow environment</code>
</dd></summary>
<hr>
.github/workflows/end-to-end-test-bubblesort-pytest.yaml
- Added environment variables for retry configuration.
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-79775fd6b8be8d2c29f2c987c7f3f4da878f6d7467e3a3d747956894eef3dbce">+3/-0</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end-to-end-test-bubblesort-unittest.yaml</strong><dd><code>Add
retry configuration to workflow environment</code>
</dd></summary>
<hr>
.github/workflows/end-to-end-test-bubblesort-unittest.yaml
- Added environment variables for retry configuration.
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-ee3e66aeadc077685724416e9467644000bbe0fdecb9de78241108f1ead99748">+3/-0</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end-to-end-test-futurehouse.yaml</strong><dd><code>Add
retry configuration to workflow environment</code>
</dd></summary>
<hr>
.github/workflows/end-to-end-test-futurehouse.yaml
- Added environment variables for retry configuration.
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-d35294f75444f6d79a6ddbf93675acf536421d17f0559394f9d49204b3babd4f">+3/-0</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end-to-end-test-tracer-replay.yaml</strong><dd><code>Add
retry configuration to workflow environment</code>
</dd></summary>
<hr>
.github/workflows/end-to-end-test-tracer-replay.yaml
- Added environment variables for retry configuration.
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-aec3cad0d643ebd26b78fcbfc354da3d1e038094b9c59aec63aaea11d8f98512">+3/-0</a>
</td>
</tr>
<tr>
<td>
<details>
<summary><strong>end-to-end-topological-sort-test.yaml</strong><dd><code>Add
retry configuration to workflow environment</code>
</dd></summary>
<hr>
.github/workflows/end-to-end-topological-sort-test.yaml
- Added environment variables for retry configuration.
</details>
</td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1272/files#diff-4849e6ce52485e16172b94ab16ff286274266e4251718044a50fa413a284a243">+3/-0</a>
</td>
</tr>
</table></details></td></tr></tr></tbody></table>
___
> 💡 **PR-Agent usage**: Comment `/help "your question"` on any pull
request to receive relevant information
|
2024-11-26 22:42:43 +00:00 |
|
Alvin Ryanputra
|
5461c86482
|
try if echo y is needed
|
2024-11-25 18:15:39 -05:00 |
|
Alvin Ryanputra
|
ac5a4f19d1
|
fixed workflow command
|
2024-11-25 18:08:01 -05:00 |
|
Alvin Ryanputra
|
113ef3e465
|
rearrange ./cli to ensure .git is removed
|
2024-11-25 18:05:58 -05:00 |
|
Alvin Ryanputra
|
b310d8ab94
|
rearrange ./cli to ensure .git is removed
|
2024-11-25 18:03:31 -05:00 |
|
Alvin Ryanputra
|
b2356639f7
|
check if .git is removed
|
2024-11-25 17:54:04 -05:00 |
|
Alvin Ryanputra
|
5c77467f92
|
modified workflow name
|
2024-11-25 17:47:28 -05:00 |
|
Alvin Ryanputra
|
f7deb89fa3
|
added one more workflow for a folder with no .git
|
2024-11-25 17:41:44 -05:00 |
|
Alvin Ryanputra
|
09bc1284ca
|
added git_remote option, fixed pyproject default option bug, attempting e2e workflow with no git
|
2024-11-25 17:07:21 -05:00 |
|
Kevin Turcios
|
77bf0a5c3c
|
Merge branch 'main' of https://github.com/codeflash-ai/codeflash into coverage_clean
|
2024-11-20 21:42:07 -04:00 |
|
Kevin Turcios
|
91acac7c57
|
fix CI output
|
2024-11-20 19:42:29 -04:00 |
|
Kevin Turcios
|
8756567faf
|
Update parse_test_output.py
Update end-to-end-test-coverage.yaml
fix tests
Revert "print blocklisted functions"
add is_in_CI utility
print blocklisted functions
add coverage collection to E2E tests
escape correctly
Update end_to_end_test_bubblesort_pytest.py
revert GHA is noisier with coverage, let's see
change name?
feedback loop
|
2024-11-20 18:09:34 -04:00 |
|
Alvin Ryanputra
|
a3966899b8
|
removed push trigger
|
2024-11-19 19:34:17 -05:00 |
|
Alvin Ryanputra
|
9ddb525d32
|
fix github token permissions for github actions
|
2024-11-19 19:27:48 -05:00 |
|
Alvin Ryanputra
|
b0b08e02ab
|
fix github token permissions for github actions
|
2024-11-19 19:22:48 -05:00 |
|