c153652856
docs: update README with new image
4 weeks ago
ad18169d77
docs: enhance README with demo GIF
4 weeks ago
89e07bc02d
chore: chore: remove unused code and dependencies
4 weeks ago
5eabd121a3
docs: update README
4 weeks ago
0b4bf54833
feat: update demo from DeepSearch to ReZero, adjusting related logging and UI components
4 weeks ago
9738b80353
feat: update max generations and output length in evaluation scripts, add memory fraction to server launch
4 weeks ago
7ee65269fb
feat: add new evaluation notebook for model testing and checkpoint evaluation
4 weeks ago
bec864038b
feat: increase max tokens and new tokens in evaluation scripts
4 weeks ago
dfa420fa49
feat: expand Makefile with serving and evaluation commands
4 weeks ago
6ba963aca3
feat: streamline data preparation in Makefile with a single command
4 weeks ago
424459d840
feat: update evaluation scripts to enhance model configuration and dataset loading, including increased max tokens and added logging
4 weeks ago
bf9f2c4102
docs: update README with setup instructions, quick demo, and data preparation steps for better clarity and usability
4 weeks ago
d7cdb6c917
chore: remove unused scripts
4 weeks ago
1e7514f98e
chore: remove outdated documentation files to clean up project structure
4 weeks ago
333d1e596e
feat: add prepare-dev-data target and script for Musique dev data transformation
4 weeks ago
504f0c6c8e
feat: update reward_em_chunk to match only the LAST required paragraph of the reasoning chain and adjust related tests
4 weeks ago
358875a035
feat: enhance reward_em_chunk function to match multiple paragraphs, add test
4 weeks ago
2df9f39fda
feat: update model configuration (longer context) and dataset loading logic for improved performance and flexibility
4 weeks ago
4a1d45271d
feat: add scripts for musique data processing
4 weeks ago
74aa673866
chores: add cook notebook for musique and model reasoning pattern
4 weeks ago
14ef79a4f5
feat: [WIP] add bench scripts
1 month ago
bd02305efb
chores: add cook notebooks
1 month ago
d8e949ec7c
feat: add Tavily search tab and integrate TavilyClient for web search functionality
1 month ago
41b7889a30
feat: integrate QA dataset loading and display gold answers in Gradio interface
1 month ago
7376f596a5
feat: add Gradio demo for DeepSearch and update configuration settings
1 month ago
7ff3623102
chore: update .gitignore, modify Makefile for installation, and add pyproject.toml for project configuration
1 month ago
eebf914a81
refactor: moved modules from src/deepsearch to src/
1 month ago
0f662d4330
refactor: moved FlashRAG submodule from src/ to third_party/
1 month ago
55f34b8503
feat: add FlashRAG as submodule
1 month ago
2fec4f2f42
refactor: change repo stucture (move code from src/ to src/deepsearch)
1 month ago
e3163081a0
docs: add experiment log for llama-3.2-3b-instruct experiments
1 month ago
010957cd99
feat: disable randomization option to get_qa_dataset function by default
1 month ago
56911a73f9
Update README.md
1 month ago
1a18cd7bfd
feat: update training and evaluation configurations (editable agent generation scripts)
...
Increased max_generations parameter in agentic_generate and run_eval functions for improved output flexibility.
1 month ago
77f121662f
test: add tests for reward_retry function scenarios
1 month ago
c8714e0f6b
feat: enhance reward_retry function to handle missing answer tags
...
Added logic to return 0 if the final message from the assistant does not contain answer tags (no matter how hard you try, you won't get anything if no result 💀 )
1 month ago
bf480574a2
fix: minor bug
1 month ago
3081d6e36b
test: added tests for new reward functions: search strategy and search diversity
1 month ago
4de31e0f30
feat: expand reward functions with new strategies and diversity checks
...
- Added reward functions for search strategy and search diversity
- Updated reward_format to include validation for proper message endings.
1 month ago
d0e6068055
fix: strengthen reward correctness logic to handle final message is not asnwer form assistant. Also update logs for reward functions for better debug
...
- Added 'logs/' directory to .gitignore to exclude log files.
- Introduced log_chat_state function to log chat states and rewards to JSONL files.
- Updated reward functions to log chat states with validation results for better tracking and debugging.
1 month ago
1bd609dfae
test: enhance reward correctness tests with validation logic
...
- Updated test cases to include role and tag validation for assistant messages.
- Ensured that only properly formatted messages with answer tags are accepted.
- Added new test for validating various incorrect formats and their expected outcomes.
1 month ago
338655e563
feat: refine user prompt logic for improved clarity and structure
1 month ago
6d994feeb2
feat: enhance evaluation scripts for base and LoRA models
1 month ago
da60b52bd1
feat: refactor download and upload scripts for improved argument handling (more notebook friendly :D)
1 month ago
fa3c0562fe
feat: add evaluation scripts for base and LoRA models
...
- Introduced `eval_base.py` for evaluating base model performance.
- Introduced `eval_lora.py` for evaluating LoRA model performance with additional LoRA weight handling.
1 month ago
1047e2fa1c
chore: update .gitignore and requirements for unsloth versions
1 month ago
83f86869f6
chore: update .gitignore and add new toys data files
1 month ago
133cb1ab90
test: add Qwen tokenizer adapter tests
...
Implemented unit tests for the Qwen tokenizer adapter, including format handling, mask generation, and multi-turn conversation support
1 month ago
6efe01d5ff
chore: update Makefile and requirements for testing
...
- Added a 'test' target in Makefile to run unit tests using pytest.
- Included 'wandb' in requirements.txt for experiment tracking.
1 month ago
af7f38c792
feat: add code for qwen architecture
1 month ago
thinhlpg
automaticcat