codeflash-admin/codeflash
1
0
Fork 0
mirror of https://github.com/codeflash-ai/codeflash.git synced 2026-05-04 18:25:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
7995 commits 508 branches 66 tags 118 MiB
Commit graph

217 commits

Author SHA1 Message Date
Alvin Ryanputra
a73b541159 initial implementation for pytest benchmark discovery 2025-04-09 17:13:06 -07:00
Alvin Ryanputra
d653d0dc42 draft of end to end test 2025-04-08 13:32:21 -07:00
Kevin Turcios
080be20753 determinism 2025-04-03 22:30:15 -05:00
Aseem Saxena
00abefbe6f more tests 2025-03-31 18:36:32 -07:00
Aseem Saxena
82f4138539 cleaning up 2025-03-28 19:31:52 -07:00
Aseem Saxena
7ffe25f757 works, optimization list length will be incorrectly displayed as we are dynamically popping and appending to the list, right now appending to just the control opt candidates, need to refactor that 2025-03-28 19:09:55 -07:00
Aseem Saxena
c00e324822 works for any level of nested function 2025-03-25 18:28:54 -07:00
Aseem Saxena
89e72b7346 refactored to make a new category for line profiler tests 2025-03-25 17:46:05 -07:00
Aseem Saxena
e224234bb9 cleaning 2025-03-21 15:57:59 -07:00
Aseem Saxena
127f4664e3 todo, improve testing 2025-03-21 15:56:29 -07:00
Aseem Saxena
7a413f64e4 feedback, cleanup 2025-03-21 15:48:38 -07:00
Aseem Saxena
93623cb7c2 still debugging readonly context code 2025-03-17 16:22:15 -07:00
Kevin Turcios
2f4bdd9585
Merge branch 'main' into tracer_tracker 2025-03-13 00:34:10 +00:00
Kevin Turcios
b383d094c4 single tracer test 2025-03-11 15:16:19 -07:00
Kevin Turcios
7f2167ad50 integrate testbench as E2E replay test 2025-03-11 14:53:09 -07:00
Alvin Ryanputra
7d33b948b0 Merge branch 'refs/heads/main' into testgen-context-improvement 
# Conflicts:
#	codeflash/context/code_context_extractor.py
#	tests/test_get_read_writable_code.py
 2025-03-05 16:50:10 -08:00
Alvin Ryanputra
17a42a218c Implemented testgen context retrieval. Context retrieved is the union of read-writable code and read-only code. Did some refactors to remove code_to_optimize_with_helpers, and updated tests. 2025-03-05 16:40:23 -08:00
Kevin Turcios
f397289454 address review. 2025-03-03 16:59:25 -08:00
Kevin Turcios
f164fd2431 add test in instrumentation 2025-03-03 16:59:17 -08:00
Kevin Turcios
f40c388ef6 stdout comparison in E2E 2025-03-03 16:59:17 -08:00
Alvin Ryanputra
7b78513868 another test function for init optim 2025-01-22 16:31:56 -08:00
Alvin Ryanputra
8d5e90c741 test file for init optimization example 2025-01-22 15:02:24 -08:00
Alvin Ryanputra
7a37e6e0eb now enable instrumentation for helper classes 2025-01-21 16:22:38 -08:00
Alvin Ryanputra
0aa7ca4ea4 added verificationtype to sqlite in test results, initial work on comparator superset 2025-01-21 12:34:19 -08:00
Alvin Ryanputra
74beb029ec forgot to commit examples for tests 2024-12-31 17:31:08 -08:00
Alvin Ryanputra
a10b399dbe added helpers of helpers into readonly context, and refactored code slightly 2024-12-31 17:19:09 -08:00
Saurabh Misra
6262e80bdd Merge branch 'main' into prompt_refactor 
# Conflicts:
#	cli/codeflash/optimization/optimizer.py
 2024-12-30 14:21:02 -08:00
Alvin Ryanputra
8b3ce0e9b9 First part of a refactor. cst_context and retriever implements logic to retrieve helper functions and build up the necessary CST trees/code as read_write and read_only context. In this commit is also a bunch of test files. 2024-12-17 11:30:07 -08:00
Kevin Turcios
7735dd63f0 coverage reliability 
quick update
 2024-12-10 14:00:56 -05:00
Kevin Turcios
03f49b087f quick test. 2024-11-28 20:00:14 -05:00
RD
6b5a13af22 Running end-to-end. 2024-11-23 17:24:15 -08:00
Kevin Turcios
c548c3405b path fix 
GHA?

missing path?

print if in GHA mode

Update end-to-end-test-bubblesort-pytest.yaml

100, sweet?

Update end-to-end-test-bubblesort-pytest.yaml

future-house-as-coverage

futurehouse

more coverage

invalid path

update

quick modification

final update.
 2024-11-19 04:07:18 -04:00
Kevin Turcios
12f2f08d98 fix validation 
fix tests
nuked exclude accidentally

debug, not info
initial cov
add mbr
revert custom test
separate coverage parsing from test run
cleanup
fix return
 2024-11-19 01:23:04 -04:00
RD
a22ce95482 Many fixes, concolic test coverage. 2024-11-07 16:00:57 -08:00
RD
c2a08cddb8 Many fixes, concolic test coverage. 2024-11-07 11:33:10 -08:00
Saurabh Misra
e14dab0d87 trace 3 function calls 2024-11-01 16:26:55 -07:00
Saurabh Misra
c9eabd4be6 Add an end to end test for tracer 2024-10-31 19:57:48 -07:00
Saurabh Misra
bfaff1af7a make the bubble sort min performance gain much lower 2024-10-23 21:02:29 -07:00
Saurabh Misra
7fdeb68f5c Finally fix the problem (at least in my local testing) 
add an end to end regression testing for futurehouse directory structure as well
 2024-10-23 18:02:05 -07:00
Saurabh Misra
853ec2c934 Fix cli tests 2024-10-23 14:38:23 -07:00
Saga4
c6fb0f800c resolving as per code suggestions 2024-10-19 04:13:26 +05:30
Saga4
c7eedfbcff fixes issue and removing unnecessary complexity 2024-10-18 04:25:52 +05:30
Saga4
c93c6ad675 trying to print debug logs, will revert post debugging 2024-10-18 03:03:35 +05:30
Saga4
dc3755c6bb fix issue 2024-10-18 01:02:15 +05:30
Saga4
419ebeff92 Merge latest changes from main 2024-10-17 19:56:55 +05:30
Saga4
67f09748d0 Test Case for Run Time measurement validation 2024-10-17 19:51:30 +05:30
RD
07d00ae279 Remove docstrings and all imports before testing for zero diffs. 2024-10-16 22:40:34 -07:00
Kevin Turcios
bc3e85161d Merge branch 'main' of https://github.com/codeflash-ai/codeflash into pathlib-migration 2024-10-13 18:14:44 -05:00
Saurabh Misra
3a2f211838 remove random binary characters 2024-10-13 16:09:41 -07:00
Kevin Turcios
cd4db2291a ruff format 2024-10-12 20:58:44 -05:00
ihitamandal
a45dd16aca Add conditional examples 2024-07-03 15:10:48 -07:00
ihitamandal
35b88d0d2b Move all sqlalchemy code 2024-06-27 15:37:14 -07:00
ihitamandal
8c225dd350 Merge remote-tracking branch 'origin/main' into sqlalchemy-tests 2024-06-24 15:55:37 -07:00
Saurabh Misra
455f4c6f2a Add a topological sort end to end test 2024-06-21 19:47:45 -07:00
ihitamandal
e9e7827e9d Modify test generation prompts for sqlalchemy 2024-06-18 14:22:44 -07:00
ihitamandal
370342e14c Add test generation prompts for sqlalchemy 2024-06-14 17:09:23 -07:00
ihitamandal
843468588d Merge remote-tracking branch 'origin/main' into sqlalchemy-tests 2024-06-10 15:21:46 -07:00
ihitamandal
1c96492031 Fix test set example 2024-06-07 12:46:14 -07:00
ihitamandal
4e254ba2a2 Merge remote-tracking branch 'origin/main' into improve-test-set 2024-06-04 15:15:58 -07:00
ihitamandal
c080b58a63 Remove unused test set examples 2024-06-04 15:15:29 -07:00
ihitamandal
74b5932e90 Remove unused test set examples 2024-06-04 15:14:40 -07:00
renaud
15ba0f49a0 licst crash fixin 2024-05-31 16:45:15 -07:00
renaud
a06d1e685d Fix for init-actions 2024-05-31 03:57:26 -07:00
renaud
73855c4215 Tests for book catalog experiment. 2024-05-30 18:24:44 -07:00
renaud
6034d8faa7 Tests for book catalog experiment. 2024-05-30 18:23:22 -07:00
Saurabh Misra
241ccd76b0 fix the test file 2024-05-29 15:28:41 -07:00
renaud
10c49757af Tests for book catalog experiment. 2024-05-29 15:25:54 -07:00
renaud
61cbfb1f98 Tests for book catalog experiment. 2024-05-29 15:23:22 -07:00
ihitamandal
5f47885593 Merge remote-tracking branch 'origin/main' into improve-test-set 2024-05-24 12:23:10 -07:00
ihitamandal
3938b17ce6 Modify test files and temporarily modify optimizer 2024-05-23 14:02:14 -07:00
ihitamandal
8b4be02379 Modify test file 2024-05-22 13:10:15 -07:00
renaud
e08cb2d9a2 sqlalchemy experiment wip. 2024-05-21 18:10:46 -07:00
ihitamandal
debc3d8f4b Move pie test set files 2024-05-21 10:29:26 -07:00
ihitamandal
0bdbfd5ebc Add examples to test set 2024-05-21 10:28:25 -07:00
ihitamandal
b8a99fb2da Add examples to test set 2024-05-20 16:57:15 -07:00
ihitamandal
04b282e1e1 Add examples to test set 2024-05-20 16:53:07 -07:00
ihitamandal
49cb34f706 Add examples to test set 2024-05-20 16:48:39 -07:00
ihitamandal
d46cf3e14f Add examples to test set 2024-05-20 16:43:07 -07:00
ihitamandal
9d04805ad0 Add examples to test set 2024-05-20 16:38:48 -07:00
ihitamandal
a1b29a47aa Add examples to test set 2024-05-20 16:34:52 -07:00
ihitamandal
4d80567c6b Add examples to test set 2024-05-20 15:49:20 -07:00
ihitamandal
f6472586f9 Add examples to test set 2024-05-20 11:50:34 -07:00
renaud
f4d6b766fa sqlalchemy experiment wip. 2024-05-16 15:38:37 -07:00
renaud
775fd1034c sqlalchemy experiment wip. 2024-05-16 09:55:11 -07:00
renaud
44efb5902d sqlalchemy experiment wip. 2024-05-15 20:07:11 -07:00
afik.cohen
f60a171aee Add compare_lists.py 2024-05-13 20:18:57 -07:00
ihitamandal
a8553e6a21 Add another function to identify functions to optimize from replay test 2024-04-26 15:09:42 -07:00
Saurabh Misra
ed641f37f0 Use dill as the default serializer 2024-04-17 18:57:43 -07:00
afik.cohen
2636646379 Refactor PR creation process 2024-04-12 17:38:45 -07:00
ihitamandal
bb94702485 Modify casting in test files 2024-03-14 12:02:23 -07:00
ihitamandal
c5367be1ec Change test set code into pure functions 2024-03-11 16:22:59 -07:00
ihitamandal
ea64723bf4 Modify script to change test code into pure functions 2024-03-11 10:27:46 -07:00
ihitamandal
f1a1c0a5fc Modify test file generation to call the function 2024-03-08 15:49:27 -08:00
ihitamandal
c57135a2fe Modify test files generation 2024-03-08 11:32:43 -08:00
ihitamandal
7725a173df Add pie test set files and test cases 2024-03-07 16:30:22 -08:00
ihitamandal
28f13557c7 Update test set script 2024-03-07 16:12:38 -08:00
ihitamandal
9f8f2ce705 Update script to create test set code files and tests 2024-03-07 13:35:29 -08:00
ihitamandal
a8ef4fdbbf Merge remote-tracking branch 'origin/main' into test-set-creation 2024-03-05 17:04:36 -08:00
ihitamandal
cad77ccdd4 Add test set samples 2024-03-05 17:03:26 -08:00
ihitamandal
7133885874 Add more code samples 2024-03-05 11:59:31 -08:00
ihitamandal
e09e11b963 Add preliminary code samples 2024-03-05 10:45:55 -08:00
ihitamandal
64750b6bc5 Merge remote-tracking branch 'origin/main' into parametrized-unit-tests 2024-03-04 13:07:50 -08:00
renaud
d47b91972c Test of a function mutating its unput 2024-02-29 03:18:12 -08:00
ihitamandal
2f157ecff6 Add support for unittest parameterized tests to be discovered 2024-02-20 15:09:28 -08:00
ihitamandal
6396da5466 Merge remote-tracking branch 'origin/main' into parametrized-tests 2024-02-15 16:57:09 -08:00
ihitamandal
c2e03e2219 Edits to test discovery 2024-02-14 16:37:58 -08:00
renaud
04b4abee77 Merging Base Changes. 2024-02-12 01:28:11 -08:00
ihitamandal
07401b0536 Remove temp file 2024-02-09 16:59:37 -08:00
ihitamandal
e65ccf84b9 Update test parsing logic and add instrumented tests 2024-02-09 15:46:52 -08:00
ihitamandal
fff2e2de87 Update instrumentation logic and tests 2024-02-09 14:05:06 -08:00
ihitamandal
20c4fb6af0 Add temporary test files for instrumentation logic 2024-02-05 16:27:11 -08:00
renaud
eb5234c62d Type clean-up. 2024-02-05 14:15:40 -08:00
renaud
2a57ea3a29 Gathering of data needed to create multi-file PR with optimized dependent functions in their original modules. 2024-02-05 07:23:14 -08:00
ihitamandal
97e19bfe1e Add parameterized cached test to bubble_sort.py 2024-01-31 10:36:51 -08:00
ihitamandal
30dfc55d69 Add support for parameterized tests 2024-01-29 15:01:27 -08:00
afik.cohen
15c9c17670 Fix e2e test and bubble sort test discovery 2024-01-04 18:59:03 -08:00
afik.cohen
bc50e0d8cb Move codeflash python code base to cli/ 2023-12-29 18:37:49 -08:00