217 commits

Author	SHA1	Message	Date
aseembits93	184b8533e0	some jit heavy functions	2026-01-15 17:37:52 -08:00
Aseem Saxena	00edfb1dd2	Apply suggestion from @aseembits93	2026-01-12 16:03:17 -08:00
Aseem Saxena	b5763e3b06	todo tf, jax later	2026-01-12 16:02:35 -08:00
Aseem Saxena	4c6f106ff6	Merge branch 'main' into gpu-sync-instrumentation	2026-01-12 15:46:27 -08:00
Aseem Saxena	0e93cb5ebb	only the functions we need	2026-01-09 16:03:24 -08:00
Kevin Turcios	827c15acde	update both of these	2026-01-09 02:07:25 -05:00
Kevin Turcios	70eb224d52	simplify E2E replay test	2026-01-09 02:01:12 -05:00
Aseem Saxena	d05f7bb059	detect framework from code	2026-01-07 13:52:40 -08:00
Codeflash Bot	f6302d0b32	newline	2025-11-06 14:05:01 -08:00
Aseem Saxena	dfd51285b0	Apply suggestion from @aseembits93	2025-11-06 14:04:12 -08:00
Codeflash Bot	18a260cab6	classmethod and staticmethod for testing	2025-11-06 13:57:50 -08:00
Codeflash Bot	53ebf4ba71	revert newline	2025-10-31 14:51:37 -07:00
Codeflash Bot	a2c40daa4d	tests galore	2025-10-31 14:48:17 -07:00
Codeflash Bot	553341a35b	fix test	2025-10-31 14:01:15 -07:00
ali	6ed7a6c1d3	keep tests dir	2025-10-04 23:56:01 +03:00
ali	7882edce93	also nested tests dir	2025-10-04 23:33:01 +03:00
ali	70d648fb09	tests	2025-10-04 23:12:04 +03:00
Kevin Turcios	fa705e1b5e	first pass	2025-09-26 13:53:15 -07:00
mohammed	684661e78a	typo	2025-08-06 03:40:06 +03:00
mohammed	307e6bbb0a	revert unwanted changes	2025-08-04 18:43:30 +03:00
mohammed	b6e3c0df3e	fix unit tests	2025-08-04 16:29:17 +03:00
mohammed	b3bd888d66	fix splitter pattern	2025-08-04 16:03:19 +03:00
mohammed	654a6ec251	refactoring	2025-07-26 08:49:23 +03:00
Kevin Turcios	70cecaf8c4	rank only, change formula	2025-07-02 18:44:39 -07:00
Kevin Turcios	35059a94f5	Update workload.py	2025-07-01 17:43:52 -07:00
Kevin Turcios	ea16342c1c	update tests	2025-07-01 16:53:38 -07:00
Kevin Turcios	eb9e0c6558	allow predict to be included	2025-07-01 15:02:50 -07:00
mohammed	2e394f6b8f	tests and fix global assignments imports	2025-06-29 00:23:36 +03:00
mohammed	2acda6a411	initial test files	2025-06-28 21:14:26 +03:00
Saurabh Misra	361091d1d3	make the topological sort non-deterministic	2025-06-25 16:09:29 -07:00
Kevin Turcios	66c75a4156	bug fix	2025-06-20 15:13:56 -07:00
Aseem Saxena	898a7dcf14	Update workload.py	2025-05-08 21:21:15 -07:00
Saurabh Misra	24e22c22fa	Update code_to_optimize/code_directories/simple_tracer_e2e/workload.py	2025-05-08 21:08:54 -07:00
Aseem Saxena	4455e02d83	Update workload.py	2025-05-08 21:02:18 -07:00
Alvin Ryanputra	04c19bfd6a	Merge branch 'main' into context-import-bug	2025-04-17 18:51:18 -04:00
Alvin Ryanputra	78871fe1df	gha failing on multithreaded t est	2025-04-16 19:27:45 -04:00
Alvin Ryanputra	9b4ede56a3	initial implementation	2025-04-16 14:14:05 -04:00
Alvin Ryanputra	3158f9cc1c	end to end test that proves picklepatcher works. example shown is a socket (which is unpickleable) that's used or not used	2025-04-10 21:43:56 -04:00
Alvin Ryanputra	d6ed1c33c4	Support recursive functions, and @benchmark / @pytest.mark.benchmark ways of using benchmark. created tests for all of them	2025-04-09 17:19:20 -07:00
Alvin Ryanputra	b3c83204f8	Use module path instead of file path for benchmarks, improved display to console.	2025-04-09 17:19:13 -07:00
Alvin Ryanputra	75c1be7b11	replay tests are now grouped by benchmark file. each benchmark test file will create one replay test file.	2025-04-09 17:19:12 -07:00
Alvin Ryanputra	ed8f5efcad	benchmarks root must be subdir of tests root	2025-04-09 17:19:11 -07:00
Alvin Ryanputra	baac96451e	works with multithreading, added test	2025-04-09 17:18:56 -07:00
Alvin Ryanputra	5fd112a2f9	tests pass	2025-04-09 17:18:55 -07:00
Alvin Ryanputra	adffb9d501	replay test functionality working for functions, methods, static methods, class methods, init. basic instrumentation logic for codeflash_trace done.	2025-04-09 17:18:53 -07:00
Alvin Ryanputra	26b2c4fa61	initial replay test version working	2025-04-09 17:18:51 -07:00
Alvin Ryanputra	d6217e8f8e	work on new replay_test logic	2025-04-09 17:18:22 -07:00
Alvin Ryanputra	5faccd821c	improvements	2025-04-09 17:18:22 -07:00
Alvin Ryanputra	034bed3075	basic version working on bubble sort	2025-04-09 17:18:20 -07:00
Alvin Ryanputra	965e2c818c	initial implementation for tracing benchmarks using a plugin, and projecting speedup	2025-04-09 17:18:08 -07:00
Alvin Ryanputra	a73b541159	initial implementation for pytest benchmark discovery	2025-04-09 17:13:06 -07:00
Alvin Ryanputra	d653d0dc42	draft of end to end test	2025-04-08 13:32:21 -07:00
Kevin Turcios	080be20753	determinism	2025-04-03 22:30:15 -05:00
Aseem Saxena	00abefbe6f	more tests	2025-03-31 18:36:32 -07:00
Aseem Saxena	82f4138539	cleaning up	2025-03-28 19:31:52 -07:00
Aseem Saxena	7ffe25f757	works, optimization list length will be incorrectly displayed as we are dynamically popping and appending to the list, right now appending to just the control opt candidates, need to refactor that	2025-03-28 19:09:55 -07:00
Aseem Saxena	c00e324822	works for any level of nested function	2025-03-25 18:28:54 -07:00
Aseem Saxena	89e72b7346	refactored to make a new category for line profiler tests	2025-03-25 17:46:05 -07:00
Aseem Saxena	e224234bb9	cleaning	2025-03-21 15:57:59 -07:00
Aseem Saxena	127f4664e3	todo, improve testing	2025-03-21 15:56:29 -07:00
Aseem Saxena	7a413f64e4	feedback, cleanup	2025-03-21 15:48:38 -07:00
Aseem Saxena	93623cb7c2	still debugging readonly context code	2025-03-17 16:22:15 -07:00
Kevin Turcios	2f4bdd9585	Merge branch 'main' into tracer_tracker	2025-03-13 00:34:10 +00:00
Kevin Turcios	b383d094c4	single tracer test	2025-03-11 15:16:19 -07:00
Kevin Turcios	7f2167ad50	integrate testbench as E2E replay test	2025-03-11 14:53:09 -07:00
Alvin Ryanputra	7d33b948b0	Merge branch 'refs/heads/main' into testgen-context-improvement ... # Conflicts: # codeflash/context/code_context_extractor.py # tests/test_get_read_writable_code.py	2025-03-05 16:50:10 -08:00
Alvin Ryanputra	17a42a218c	Implemented testgen context retrieval. Context retrieved is the union of read-writable code and read-only code. Did some refactors to remove code_to_optimize_with_helpers, and updated tests.	2025-03-05 16:40:23 -08:00
Kevin Turcios	f397289454	address review.	2025-03-03 16:59:25 -08:00
Kevin Turcios	f164fd2431	add test in instrumentation	2025-03-03 16:59:17 -08:00
Kevin Turcios	f40c388ef6	stdout comparison in E2E	2025-03-03 16:59:17 -08:00
Alvin Ryanputra	7b78513868	another test function for init optim	2025-01-22 16:31:56 -08:00
Alvin Ryanputra	8d5e90c741	test file for init optimization example	2025-01-22 15:02:24 -08:00
Alvin Ryanputra	7a37e6e0eb	now enable instrumentation for helper classes	2025-01-21 16:22:38 -08:00
Alvin Ryanputra	0aa7ca4ea4	added verificationtype to sqlite in test results, initial work on comparator superset	2025-01-21 12:34:19 -08:00
Alvin Ryanputra	74beb029ec	forgot to commit examples for tests	2024-12-31 17:31:08 -08:00
Alvin Ryanputra	a10b399dbe	added helpers of helpers into readonly context, and refactored code slightly	2024-12-31 17:19:09 -08:00
Saurabh Misra	6262e80bdd	Merge branch 'main' into prompt_refactor ... # Conflicts: # cli/codeflash/optimization/optimizer.py	2024-12-30 14:21:02 -08:00
Alvin Ryanputra	8b3ce0e9b9	First part of a refactor. cst_context and retriever implements logic to retrieve helper functions and build up the necessary CST trees/code as read_write and read_only context. In this commit is also a bunch of test files.	2024-12-17 11:30:07 -08:00
Kevin Turcios	7735dd63f0	coverage reliability ... quick update	2024-12-10 14:00:56 -05:00
Kevin Turcios	03f49b087f	quick test.	2024-11-28 20:00:14 -05:00
RD	6b5a13af22	Running end-to-end.	2024-11-23 17:24:15 -08:00
Kevin Turcios	c548c3405b	path fix ... GHA? missing path? print if in GHA mode Update end-to-end-test-bubblesort-pytest.yaml 100, sweet? Update end-to-end-test-bubblesort-pytest.yaml future-house-as-coverage futurehouse more coverage invalid path update quick modification final update.	2024-11-19 04:07:18 -04:00
Kevin Turcios	12f2f08d98	fix validation ... fix tests nuked exclude accidentally debug, not info initial cov add mbr revert custom test separate coverage parsing from test run cleanup fix return	2024-11-19 01:23:04 -04:00
RD	a22ce95482	Many fixes, concolic test coverage.	2024-11-07 16:00:57 -08:00
RD	c2a08cddb8	Many fixes, concolic test coverage.	2024-11-07 11:33:10 -08:00
Saurabh Misra	e14dab0d87	trace 3 function calls	2024-11-01 16:26:55 -07:00
Saurabh Misra	c9eabd4be6	Add an end to end test for tracer	2024-10-31 19:57:48 -07:00
Saurabh Misra	bfaff1af7a	make the bubble sort min performance gain much lower	2024-10-23 21:02:29 -07:00
Saurabh Misra	7fdeb68f5c	Finally fix the problem (at least in my local testing) ... add an end to end regression testing for futurehouse directory structure as well	2024-10-23 18:02:05 -07:00
Saurabh Misra	853ec2c934	Fix cli tests	2024-10-23 14:38:23 -07:00
Saga4	c6fb0f800c	resolving as per code suggestions	2024-10-19 04:13:26 +05:30
Saga4	c7eedfbcff	fixes issue and removing unnecessary complexity	2024-10-18 04:25:52 +05:30
Saga4	c93c6ad675	trying to print debug logs, will revert post debugging	2024-10-18 03:03:35 +05:30
Saga4	dc3755c6bb	fix issue	2024-10-18 01:02:15 +05:30
Saga4	419ebeff92	Merge latest changes from main	2024-10-17 19:56:55 +05:30
Saga4	67f09748d0	Test Case for Run Time measurement validation	2024-10-17 19:51:30 +05:30
RD	07d00ae279	Remove docstrings and all imports before testing for zero diffs.	2024-10-16 22:40:34 -07:00
Kevin Turcios	bc3e85161d	Merge branch 'main' of https://github.com/codeflash-ai/codeflash into pathlib-migration	2024-10-13 18:14:44 -05:00
Saurabh Misra	3a2f211838	remove random binary characters	2024-10-13 16:09:41 -07:00
Kevin Turcios	cd4db2291a	ruff format	2024-10-12 20:58:44 -05:00