Commit graph

211 commits

Author SHA1 Message Date
Aseem Saxena
c00e324822 works for any level of nested function 2025-03-25 18:28:54 -07:00
Aseem Saxena
89e72b7346 refactored to make a new category for line profiler tests 2025-03-25 17:46:05 -07:00
Aseem Saxena
e224234bb9 cleaning 2025-03-21 15:57:59 -07:00
Aseem Saxena
127f4664e3 todo, improve testing 2025-03-21 15:56:29 -07:00
Aseem Saxena
7a413f64e4 feedback, cleanup 2025-03-21 15:48:38 -07:00
Aseem Saxena
93623cb7c2 still debugging readonly context code 2025-03-17 16:22:15 -07:00
Kevin Turcios
2f4bdd9585
Merge branch 'main' into tracer_tracker 2025-03-13 00:34:10 +00:00
Kevin Turcios
b383d094c4 single tracer test 2025-03-11 15:16:19 -07:00
Kevin Turcios
7f2167ad50 integrate testbench as E2E replay test 2025-03-11 14:53:09 -07:00
Alvin Ryanputra
7d33b948b0 Merge branch 'refs/heads/main' into testgen-context-improvement
# Conflicts:
#	codeflash/context/code_context_extractor.py
#	tests/test_get_read_writable_code.py
2025-03-05 16:50:10 -08:00
Alvin Ryanputra
17a42a218c Implemented testgen context retrieval. Context retrieved is the union of read-writable code and read-only code. Did some refactors to remove code_to_optimize_with_helpers, and updated tests. 2025-03-05 16:40:23 -08:00
Kevin Turcios
f397289454 address review. 2025-03-03 16:59:25 -08:00
Kevin Turcios
f164fd2431 add test in instrumentation 2025-03-03 16:59:17 -08:00
Kevin Turcios
f40c388ef6 stdout comparison in E2E 2025-03-03 16:59:17 -08:00
Alvin Ryanputra
7b78513868 another test function for init optim 2025-01-22 16:31:56 -08:00
Alvin Ryanputra
8d5e90c741 test file for init optimization example 2025-01-22 15:02:24 -08:00
Alvin Ryanputra
7a37e6e0eb now enable instrumentation for helper classes 2025-01-21 16:22:38 -08:00
Alvin Ryanputra
0aa7ca4ea4 added verificationtype to sqlite in test results, initial work on comparator superset 2025-01-21 12:34:19 -08:00
Alvin Ryanputra
74beb029ec forgot to commit examples for tests 2024-12-31 17:31:08 -08:00
Alvin Ryanputra
a10b399dbe added helpers of helpers into readonly context, and refactored code slightly 2024-12-31 17:19:09 -08:00
Saurabh Misra
6262e80bdd Merge branch 'main' into prompt_refactor
# Conflicts:
#	cli/codeflash/optimization/optimizer.py
2024-12-30 14:21:02 -08:00
Alvin Ryanputra
8b3ce0e9b9 First part of a refactor. cst_context and retriever implements logic to retrieve helper functions and build up the necessary CST trees/code as read_write and read_only context. In this commit is also a bunch of test files. 2024-12-17 11:30:07 -08:00
Kevin Turcios
7735dd63f0 coverage reliability
quick update
2024-12-10 14:00:56 -05:00
Kevin Turcios
03f49b087f quick test. 2024-11-28 20:00:14 -05:00
RD
6b5a13af22 Running end-to-end. 2024-11-23 17:24:15 -08:00
Kevin Turcios
c548c3405b path fix
GHA?

missing path?

print if in GHA mode

Update end-to-end-test-bubblesort-pytest.yaml

100, sweet?

Update end-to-end-test-bubblesort-pytest.yaml

future-house-as-coverage

futurehouse

more coverage

invalid path

update

quick modification

final update.
2024-11-19 04:07:18 -04:00
Kevin Turcios
12f2f08d98 fix validation
fix tests
nuked exclude accidentally

debug, not info
initial cov
add mbr
revert custom test
separate coverage parsing from test run
cleanup
fix return
2024-11-19 01:23:04 -04:00
RD
a22ce95482 Many fixes, concolic test coverage. 2024-11-07 16:00:57 -08:00
RD
c2a08cddb8 Many fixes, concolic test coverage. 2024-11-07 11:33:10 -08:00
Saurabh Misra
e14dab0d87 trace 3 function calls 2024-11-01 16:26:55 -07:00
Saurabh Misra
c9eabd4be6 Add an end to end test for tracer 2024-10-31 19:57:48 -07:00
Saurabh Misra
bfaff1af7a make the bubble sort min performance gain much lower 2024-10-23 21:02:29 -07:00
Saurabh Misra
7fdeb68f5c Finally fix the problem (at least in my local testing)
add an end to end regression testing for futurehouse directory structure as well
2024-10-23 18:02:05 -07:00
Saurabh Misra
853ec2c934 Fix cli tests 2024-10-23 14:38:23 -07:00
Saga4
c6fb0f800c resolving as per code suggestions 2024-10-19 04:13:26 +05:30
Saga4
c7eedfbcff fixes issue and removing unnecessary complexity 2024-10-18 04:25:52 +05:30
Saga4
c93c6ad675 trying to print debug logs, will revert post debugging 2024-10-18 03:03:35 +05:30
Saga4
dc3755c6bb fix issue 2024-10-18 01:02:15 +05:30
Saga4
419ebeff92 Merge latest changes from main 2024-10-17 19:56:55 +05:30
Saga4
67f09748d0 Test Case for Run Time measurement validation 2024-10-17 19:51:30 +05:30
RD
07d00ae279 Remove docstrings and all imports before testing for zero diffs. 2024-10-16 22:40:34 -07:00
Kevin Turcios
bc3e85161d Merge branch 'main' of https://github.com/codeflash-ai/codeflash into pathlib-migration 2024-10-13 18:14:44 -05:00
Saurabh Misra
3a2f211838 remove random binary characters 2024-10-13 16:09:41 -07:00
Kevin Turcios
cd4db2291a ruff format 2024-10-12 20:58:44 -05:00
ihitamandal
a45dd16aca Add conditional examples 2024-07-03 15:10:48 -07:00
ihitamandal
35b88d0d2b Move all sqlalchemy code 2024-06-27 15:37:14 -07:00
ihitamandal
8c225dd350 Merge remote-tracking branch 'origin/main' into sqlalchemy-tests 2024-06-24 15:55:37 -07:00
Saurabh Misra
455f4c6f2a Add a topological sort end to end test 2024-06-21 19:47:45 -07:00
ihitamandal
e9e7827e9d Modify test generation prompts for sqlalchemy 2024-06-18 14:22:44 -07:00
ihitamandal
370342e14c Add test generation prompts for sqlalchemy 2024-06-14 17:09:23 -07:00
ihitamandal
843468588d Merge remote-tracking branch 'origin/main' into sqlalchemy-tests 2024-06-10 15:21:46 -07:00
ihitamandal
1c96492031 Fix test set example 2024-06-07 12:46:14 -07:00
ihitamandal
4e254ba2a2 Merge remote-tracking branch 'origin/main' into improve-test-set 2024-06-04 15:15:58 -07:00
ihitamandal
c080b58a63 Remove unused test set examples 2024-06-04 15:15:29 -07:00
ihitamandal
74b5932e90 Remove unused test set examples 2024-06-04 15:14:40 -07:00
renaud
15ba0f49a0 licst crash fixin 2024-05-31 16:45:15 -07:00
renaud
a06d1e685d Fix for init-actions 2024-05-31 03:57:26 -07:00
renaud
73855c4215 Tests for book catalog experiment. 2024-05-30 18:24:44 -07:00
renaud
6034d8faa7 Tests for book catalog experiment. 2024-05-30 18:23:22 -07:00
Saurabh Misra
241ccd76b0 fix the test file 2024-05-29 15:28:41 -07:00
renaud
10c49757af Tests for book catalog experiment. 2024-05-29 15:25:54 -07:00
renaud
61cbfb1f98 Tests for book catalog experiment. 2024-05-29 15:23:22 -07:00
ihitamandal
5f47885593 Merge remote-tracking branch 'origin/main' into improve-test-set 2024-05-24 12:23:10 -07:00
ihitamandal
3938b17ce6 Modify test files and temporarily modify optimizer 2024-05-23 14:02:14 -07:00
ihitamandal
8b4be02379 Modify test file 2024-05-22 13:10:15 -07:00
renaud
e08cb2d9a2 sqlalchemy experiment wip. 2024-05-21 18:10:46 -07:00
ihitamandal
debc3d8f4b Move pie test set files 2024-05-21 10:29:26 -07:00
ihitamandal
0bdbfd5ebc Add examples to test set 2024-05-21 10:28:25 -07:00
ihitamandal
b8a99fb2da Add examples to test set 2024-05-20 16:57:15 -07:00
ihitamandal
04b282e1e1 Add examples to test set 2024-05-20 16:53:07 -07:00
ihitamandal
49cb34f706 Add examples to test set 2024-05-20 16:48:39 -07:00
ihitamandal
d46cf3e14f Add examples to test set 2024-05-20 16:43:07 -07:00
ihitamandal
9d04805ad0 Add examples to test set 2024-05-20 16:38:48 -07:00
ihitamandal
a1b29a47aa Add examples to test set 2024-05-20 16:34:52 -07:00
ihitamandal
4d80567c6b Add examples to test set 2024-05-20 15:49:20 -07:00
ihitamandal
f6472586f9 Add examples to test set 2024-05-20 11:50:34 -07:00
renaud
f4d6b766fa sqlalchemy experiment wip. 2024-05-16 15:38:37 -07:00
renaud
775fd1034c sqlalchemy experiment wip. 2024-05-16 09:55:11 -07:00
renaud
44efb5902d sqlalchemy experiment wip. 2024-05-15 20:07:11 -07:00
afik.cohen
f60a171aee Add compare_lists.py 2024-05-13 20:18:57 -07:00
ihitamandal
a8553e6a21 Add another function to identify functions to optimize from replay test 2024-04-26 15:09:42 -07:00
Saurabh Misra
ed641f37f0 Use dill as the default serializer 2024-04-17 18:57:43 -07:00
afik.cohen
2636646379 Refactor PR creation process 2024-04-12 17:38:45 -07:00
ihitamandal
bb94702485 Modify casting in test files 2024-03-14 12:02:23 -07:00
ihitamandal
c5367be1ec Change test set code into pure functions 2024-03-11 16:22:59 -07:00
ihitamandal
ea64723bf4 Modify script to change test code into pure functions 2024-03-11 10:27:46 -07:00
ihitamandal
f1a1c0a5fc Modify test file generation to call the function 2024-03-08 15:49:27 -08:00
ihitamandal
c57135a2fe Modify test files generation 2024-03-08 11:32:43 -08:00
ihitamandal
7725a173df Add pie test set files and test cases 2024-03-07 16:30:22 -08:00
ihitamandal
28f13557c7 Update test set script 2024-03-07 16:12:38 -08:00
ihitamandal
9f8f2ce705 Update script to create test set code files and tests 2024-03-07 13:35:29 -08:00
ihitamandal
a8ef4fdbbf Merge remote-tracking branch 'origin/main' into test-set-creation 2024-03-05 17:04:36 -08:00
ihitamandal
cad77ccdd4 Add test set samples 2024-03-05 17:03:26 -08:00
ihitamandal
7133885874 Add more code samples 2024-03-05 11:59:31 -08:00
ihitamandal
e09e11b963 Add preliminary code samples 2024-03-05 10:45:55 -08:00
ihitamandal
64750b6bc5 Merge remote-tracking branch 'origin/main' into parametrized-unit-tests 2024-03-04 13:07:50 -08:00
renaud
d47b91972c Test of a function mutating its unput 2024-02-29 03:18:12 -08:00
ihitamandal
2f157ecff6 Add support for unittest parameterized tests to be discovered 2024-02-20 15:09:28 -08:00
ihitamandal
6396da5466 Merge remote-tracking branch 'origin/main' into parametrized-tests 2024-02-15 16:57:09 -08:00
ihitamandal
c2e03e2219 Edits to test discovery 2024-02-14 16:37:58 -08:00
renaud
04b4abee77 Merging Base Changes. 2024-02-12 01:28:11 -08:00
ihitamandal
07401b0536 Remove temp file 2024-02-09 16:59:37 -08:00
ihitamandal
e65ccf84b9 Update test parsing logic and add instrumented tests 2024-02-09 15:46:52 -08:00
ihitamandal
fff2e2de87 Update instrumentation logic and tests 2024-02-09 14:05:06 -08:00
ihitamandal
20c4fb6af0 Add temporary test files for instrumentation logic 2024-02-05 16:27:11 -08:00
renaud
eb5234c62d Type clean-up. 2024-02-05 14:15:40 -08:00
renaud
2a57ea3a29 Gathering of data needed to create multi-file PR with optimized dependent functions in their original modules. 2024-02-05 07:23:14 -08:00
ihitamandal
97e19bfe1e Add parameterized cached test to bubble_sort.py 2024-01-31 10:36:51 -08:00
ihitamandal
30dfc55d69 Add support for parameterized tests 2024-01-29 15:01:27 -08:00
afik.cohen
15c9c17670 Fix e2e test and bubble sort test discovery 2024-01-04 18:59:03 -08:00
afik.cohen
bc50e0d8cb Move codeflash python code base to cli/ 2023-12-29 18:37:49 -08:00