codeflash-ai/codeflash-internal
1
0
Fork 0
mirror of https://github.com/codeflash-ai/codeflash-internal.git synced 2026-05-04 18:25:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6334 commits 787 branches 64 tags 168 MiB
Commit graph

27 commits

Author SHA1 Message Date
Kevin Turcios
28237eb8bb move sqlalchemy, gen_inspired_tests, and mistral 2025-12-30 15:22:39 -05:00
Aseem Saxena
1192df12a6
feedback loop for unmatched test results (#2059) 
fixes CF-932

# Pull Request Checklist

## Description
- [ ] **Description of PR**: Clear and concise description of what this
PR accomplishes
- [ ] **Breaking Changes**: Document any breaking changes (if
applicable)
- [ ] **Related Issues**: Link to any related issues or tickets

## Testing
- [ ] **Test cases Attached**: All relevant test cases have been
added/updated
- [ ] **Manual Testing**: Manual testing completed for the changes

## Monitoring & Debugging
- [ ] **Logging in place**: Appropriate logging has been added for
debugging user issues
- [ ] **Sentry will be able to catch errors**: Error handling ensures
Sentry can capture and report errors
- [ ] **Avoid Dev based/Prisma logging**: No development-only or
Prisma-specific logging in production code

## Configuration
- [ ] **Env variables newly added**: Any new environment variables are
documented in .env.example file or mentioned in description
---

## Additional Notes
<!-- Add any additional context, screenshots, or notes for reviewers
here -->

---------

Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: ali <mohammed18200118@gmail.com>
Co-authored-by: Kevin Turcios <106575910+KRRT7@users.noreply.github.com>
 2025-12-17 08:14:32 +05:30
mashraf-222
8216f32d9e
Optimization Factory update (#2035) 
Co-authored-by: Mohamed Ashraf <mohamedashrraf222@gmail.com>
Co-authored-by: Sarthak Agarwal <sarthak.saga@gmail.com>
Co-authored-by: Kevin Turcios <106575910+KRRT7@users.noreply.github.com>
 2025-12-08 23:22:32 +05:30
mashraf-222
e785a7676b
Enhancing tests catching in the optimization factory script (#1887) 
1. **New log with ANSI codes** (`tests-2025-10-07T22-58-04-00-00.log`):
   - **Before**: `passed=0 failed=1 errors=28 ratio=0%` ❌
   - **After**: `passed=28441 failed=46 errors=0 ratio=99%` ✅

2. **Original log with errors** (`tests-2025-10-07T22-56-48-00-00.log`):
   - **Before**: `passed=0 failed=0 errors=83 ratio=0%` ❌  
   - **After**: `passed=44359 failed=0 errors=83 ratio=99%` ✅

3. **Interrupted log without summary**
(`tests-2025-10-07T01-59-08-00-00.log`):
   - **Before**: `passed=0 failed=1 errors=0 ratio=0%` ❌
- **After**: Uses fallback method to count individual
`PASSED`/`FAILED`/`SKIPPED` lines ✅

### ✅ **Implementation Details:**

The current script now uses:
```bash
# Primary method: Extract from summary lines
PASSED=$(grep -oE '[0-9]+ passed' "$TEST_LOG_FILE" | tail -n1 | grep -oE '[0-9]+')
FAILED=$(grep -oE '[0-9]+ failed' "$TEST_LOG_FILE" | tail -n1 | grep -oE '[0-9]+')
ERRORS=$(grep -oE '[0-9]+ errors' "$TEST_LOG_FILE" | tail -n1 | grep -oE '[0-9]+')

# Fallback method: Count individual test results
if [ -z "$PASSED" ] && [ -z "$FAILED" ] && [ -z "$ERRORS" ]; then
  PASSED=$(grep -c "PASSED" "$TEST_LOG_FILE" 2>/dev/null || echo "0")
  FAILED=$(grep -c "FAILED" "$TEST_LOG_FILE" 2>/dev/null || echo "0")
  SKIPPED=$(grep -c "SKIPPED" "$TEST_LOG_FILE" 2>/dev/null || echo "0")
fi
```

### ✅ **Key Improvements:**

1. **Handles ANSI color codes** - `grep -oE` ignores color codes and
extracts the actual numbers
2. **Robust regex patterns** - Uses `[0-9]+` instead of greedy `.*`
patterns
3. **Fallback mechanism** - Counts individual test results when no
summary line exists
4. **Works with all pytest formats** - Handles both `X passed, Y failed,
Z errors` and `X passed, Y errors` formats

### ✅ **Conclusion:**

**Yes, the current implementation will correctly catch all types of test
results** from the three log files you mentioned. The script will now:

- ✅ Correctly parse `28441 passed` from ANSI-colored summary lines
- ✅ Correctly parse `44359 passed` from clean summary lines  
- ✅ Correctly parse `83 errors` when present
- ✅ Fall back to counting individual test results for interrupted runs
- ✅ Calculate accurate pass ratios (99% instead of 0%)

---------

Co-authored-by: Mohamed Ashraf <mohamedashrraf222@gmail.com>
Co-authored-by: Sarthak Agarwal <sarthak.saga@gmail.com>
Co-authored-by: Kevin Turcios <106575910+KRRT7@users.noreply.github.com>
 2025-10-23 19:27:00 -07:00
mashraf-222
ebd1755359
Feature/optimizer updates (#1871) 
- Introduced new API endpoints for downloading individual archived logs
and all logs for a repository as a ZIP file.
- Enhanced the CSV handling in the application to include new fields for
auto-termination and analysis configuration.
- Updated the frontend to support new features, including a modal for
auto-termination settings and improved UI for log management.
- Updated styles for modals and tables to enhance visual consistency and
usability."
- Added Dumpy security code in the FE with "123456"
- added ability to customize and view the repo analysis by the LLM
results
- adding deployment folder for the whole deployment flow along with the
dogs
- fixed some permission errors and ssh access by www-data user while
deployment
- added s3 bucket saving logs based

---------

Co-authored-by: Ashraf <ashraf@rapiddata.io>
Co-authored-by: Mohamed Ashraf <mohamedashrraf222@gmail.com>
Co-authored-by: Kevin Turcios <106575910+KRRT7@users.noreply.github.com>
Co-authored-by: Sarthak Agarwal <sarthak.saga@gmail.com>
 2025-10-11 02:08:21 -07:00
Kevin Turcios
1cc26bf5b4
Merge branch 'main' into opt-impact-aseem 2025-10-06 23:23:59 +00:00
Sarthak Agarwal
0c16414301
optimization Pipeline (#1860) 
Co-authored-by: saga4 <saga4@codeflashs-MacBook-Air.local>
 2025-10-02 12:21:10 -07:00
aseembits93
22cd8dc753 ranking experiment file 2025-09-22 12:08:26 -07:00
aseembits93
7cd768e0e7 ready to merge 2025-05-09 19:42:20 -07:00
aseembits93
4f572c0cf6 ab testing with optimize me 2025-05-08 12:00:52 -07:00
Aseem Saxena
b56fcc5c45 ruff format for metric analysis 2025-04-21 14:29:09 -07:00
Aseem Saxena
63386273a4 more metrics 2025-04-21 14:14:09 -07:00
Aseem Saxena
dacab4fef1 undo structured output 2025-04-16 20:05:19 -07:00
Aseem Saxena
c9dade08b0 current model claude 2025-04-16 18:02:24 -07:00
Aseem Saxena
2df0551d6a more filtering for saner metrics 2025-04-16 10:45:14 -07:00
Saurabh Misra
d4d0b85898 move data from cli/experiments and cli/pie_test_set to top-level experiments directory 2025-02-12 22:32:45 -05:00
renaud
9e6ef9aa61 sqlalchemy experiment wip. 2024-05-22 15:53:45 -07:00
Saurabh Misra
9e0f9dee75 checkin non working picling sqlalchemy notebook 2024-05-22 11:13:21 -07:00
Saurabh Misra
d689a5509a pickling sqlalchemy exp 2024-05-21 19:17:07 -07:00
afik.cohen
146aa1205c Remove overrides decorator 2024-05-06 19:37:08 -07:00
renaud
f060e2cc08 Test of a function mutating its unput 2024-02-29 03:18:12 -08:00
renaud
3408ef43f1 Fixed all the tests. All of them. 2024-02-28 10:44:12 -08:00
renaud
3191f93d72 Generalizing parse tree editing to any named statement (function, class). 2024-02-08 22:05:41 -08:00
Saurabh Misra
378c5822d6 Remove unnecessary admin portal and middleware from django server 2024-02-01 18:26:44 -08:00
renaud
96cf7c78ca Made the prompt agnostic to the chosen testing library 2024-01-30 18:19:48 -08:00
renaud
e54b8db118 Edited prompt to forbid mocks or stubs during test generation 2024-01-30 12:26:32 -08:00
Saurabh Misra
c7eda167d5 Test generator should not mock things 2024-01-30 12:24:27 -08:00