Commit graph

3712 commits

Author SHA1 Message Date
Sarthak Agarwal
cd2f6d7485
fix issue with e2e test fail (#1329)
To fix the issue of failing E2E tests even on success in subsequent
retries.

https://github.com/codeflash-ai/codeflash/actions/runs/12128697056/job/33815619876?pr=1325
2024-12-06 14:35:58 -05:00
Kevin Turcios
1ad78ea125
Merge pull request #1332 from codeflash-ai/fh-quick-fix
Future-house/Aviary quick fix
2024-12-06 04:25:46 -05:00
Kevin Turcios
fd347e29cf review response
verify setup is implied here
2024-12-06 04:08:55 -05:00
Kevin Turcios
0b3630797d add coverage message when suggesting 2024-12-06 03:53:12 -05:00
Kevin Turcios
0ba3c01c73 no-pr 2024-12-06 03:42:35 -05:00
Kevin Turcios
2b5c1eea4e 3 significant digits. 2024-12-06 03:40:21 -05:00
Saurabh Misra
a1a3fc112d
Merge pull request #1330 from codeflash-ai/release/v0.8.0
Codeflash version 0.8.0
2024-12-04 09:20:53 +05:30
Saurabh Misra
6a1f18f02a Codeflash version 0.8.0 2024-12-03 18:37:55 -08:00
Kevin Turcios
8f9cf436cd
Merge pull request #1310 from codeflash-ai/verify-setup
Verify setup issues
2024-12-04 02:25:28 +00:00
Kevin Turcios
31b586b5d0
Merge branch 'main' into verify-setup 2024-12-04 01:04:19 +00:00
Alvin Ryanputra
b960536bd6
Merge pull request #1328 from codeflash-ai/test_discovery_pytest_unittest
improved test discovery for unittest using pytest
2024-12-03 20:00:48 -05:00
Kevin Turcios
1a6eedb61a
Merge branch 'main' into verify-setup 2024-12-04 00:23:05 +00:00
Alvin Ryanputra
4ed84fdc38
Merge branch 'main' into test_discovery_pytest_unittest 2024-12-03 17:49:47 -05:00
Alvin Ryanputra
14669ac0f2 pytest can be used to also detect unittest cases, although we can't get the parameters for parameterized unittest type of tests. This is good for repos that use pytest to run both pytest/unittest tests.
Additionally, made some changes for cases where tests were not being discovered
2024-12-03 17:32:40 -05:00
Saurabh Misra
fa2e4b7396
Merge pull request #1327 from codeflash-ai/reject-failing-existing-test-optimizations
Catch cases where existing tests change test status
2024-12-04 02:32:31 +05:30
Saurabh Misra
17da47e2fb check pass condition for concolic test as well 2024-12-02 17:31:06 -08:00
Saurabh Misra
6863860980
Merge branch 'main' into reject-failing-existing-test-optimizations 2024-12-03 06:41:58 +05:30
Saurabh Misra
cdbf6424f9 Catch cases where existing tests change test status 2024-12-02 17:09:58 -08:00
Saurabh Misra
e0bb057e0c
Merge pull request #1325 from codeflash-ai/optimize-all-bugfixing
ignore directory deletion errors
2024-12-03 06:39:55 +05:30
Saurabh Misra
023e134673
Merge branch 'main' into optimize-all-bugfixing 2024-12-03 03:28:42 +05:30
Saurabh Misra
eafa1f9e5c log error 2024-12-02 13:58:21 -08:00
Sarthak Agarwal
6eab41b47b
remove failed test count from PR description (#1326)
https://codeflash-ai.slack.com/archives/C06BVLNRVT5/p1733172907804319
2024-12-02 13:49:28 -08:00
Kevin Turcios
5296b89d1e Update formatter.py 2024-12-01 21:22:53 -05:00
Kevin Turcios
2176b0ca00 quick test. 2024-11-28 20:00:14 -05:00
Kevin Turcios
e85a857134 fix tests 2 2024-11-28 19:17:15 -05:00
Kevin Turcios
b577d2098f fix tests 2024-11-28 19:15:14 -05:00
Kevin Turcios
064489ee7c verify setup 2024-11-28 18:18:35 -05:00
Kevin Turcios
8e0e1254a0 rules rule. 2024-11-28 18:18:35 -05:00
Sarthak Agarwal
0e9cbf434a
Fix stdout logs in GA (#1308)
closes
https://linear.app/codeflash-ai/issue/CF-469/restore-output-of-e2e-tests-being-retried


### **PR Type**
enhancement, tests


___

### **Description**
- Enhanced the logging mechanism in the end-to-end test utilities by
setting the log level to DEBUG.
- Introduced a logger to capture detailed information during test
retries, aiding in debugging and development.



___



### **Changes walkthrough** 📝
<table><thead><tr><th></th><th align="left">Relevant
files</th></tr></thead><tbody><tr><td><strong>Enhancement</strong></td><td><table>
<tr>
  <td>
    <details>
<summary><strong>end_to_end_test_utilities.py</strong><dd><code>Enable
detailed logging for test retries in end-to-end
utilities</code></dd></summary>
<hr>

cli/tests/scripts/end_to_end_test_utilities.py

<li>Added logging configuration to set the log level to DEBUG.<br> <li>
Introduced a logger to capture detailed information during test
<br>retries.<br>


</details>


  </td>
<td><a
href="https://github.com/codeflash-ai/codeflash/pull/1308/files#diff-d6562a24bc8e90ad167216799f102fec1f497b17042cbe7ea76d0fd11f8591d6">+2/-1</a>&nbsp;
&nbsp; &nbsp; </td>

</tr>
</table></td></tr></tr></tbody></table>

___

> 💡 **PR-Agent usage**: Comment `/help "your question"` on any pull
request to receive relevant information
2024-11-28 14:52:16 +00:00
Saurabh Misra
0e37c77383 ignore directory deletion errors 2024-11-28 16:08:54 +05:30
Saurabh Misra
f7bd9a45bc
Merge pull request #1309 from codeflash-ai/default-remote-origin
Make the default remote as origin
2024-11-28 04:28:40 +05:30
Saurabh Misra
c63b928086 try the fix 2024-11-28 04:00:15 +05:30
Kevin Turcios
47d28a040c
Merge pull request #1304 from codeflash-ai/duplicates_inlines
Duplicates inlines
2024-11-27 16:26:15 -05:00
Kevin Turcios
eeb4d0b1cc
Merge branch 'main' into duplicates_inlines 2024-11-27 15:53:13 -05:00
Saurabh Misra
cabad31289
Merge pull request #1274 from codeflash-ai/cli_set_remote
Added option during codeflash init to choose which remote to push to (CF-312)
2024-11-28 02:05:02 +05:30
Alvin Ryanputra
b76469641b
Merge branch 'main' into cli_set_remote 2024-11-26 23:18:48 -05:00
Kevin Turcios
b5730dfc10 stray console. 2024-11-26 22:50:58 -05:00
Kevin Turcios
19ca04b06f Merge branch 'main' of https://github.com/codeflash-ai/codeflash into duplicates_inlines 2024-11-26 22:43:14 -05:00
Kevin Turcios
733d1b4836 delete test file. 2024-11-26 22:42:54 -05:00
Kevin Turcios
fc66018b82 remove debug stuff
create test_file
hello world.
2024-11-26 22:34:53 -05:00
Saurabh Misra
9190ec5b7c
Merge pull request #1297 from codeflash-ai/saurabh/small-changes
some quality of life fixes
2024-11-27 08:01:47 +05:30
RD
bd3310a28f
Merge branch 'main' into saurabh/small-changes 2024-11-26 16:26:20 -08:00
Alvin Ryanputra
8b773dba24
Merge branch 'main' into cli_set_remote 2024-11-26 19:25:12 -05:00
Alvin Ryanputra
d33fbec85e removed pytest, only have pytest-no-git instead 2024-11-26 19:21:06 -05:00
Saurabh Misra
b2569726ae
Merge pull request #1298 from codeflash-ai/doc-search
Implement algolia search and update package versions
2024-11-27 05:50:52 +05:30
Alvin Ryanputra
8fa0980a94 Merge branch 'main' into cli_set_remote
# Conflicts:
#	cli/codeflash/optimization/optimizer.py
#	cli/codeflash/result/create_pr.py
2024-11-26 19:17:57 -05:00
Saurabh Misra
cb06e8180b Implement algolia search and update package versions 2024-11-27 05:47:43 +05:30
Saurabh Misra
206440b4dd some quality of life fixes 2024-11-27 05:29:06 +05:30
Kevin Turcios
9312f8616f
Merge pull request #1296 from codeflash-ai/coverage-follow-up
Coverage follow up
2024-11-26 18:05:17 -05:00
Kevin Turcios
11894e3997 Merge branch 'main' of https://github.com/codeflash-ai/codeflash into coverage-follow-up 2024-11-26 17:51:53 -05:00