Sounds good, thanks!
Eric PRO
Dorman11
AI & ML interests
Currently training Endeavor, a SLM model! Interests include: Agentic security, Machine Learning, Reinforcement Learning, PyTorch and all around web dev ninja! Level II Specialist working in Cyber Security field.
Organizations
replied to Banaxi-Tech's post 2 months ago
replied to Banaxi-Tech's post 2 months ago
Yeah that’s along the line of what I thought it was. Since the Banana models seem to be text generation, I don’t suppose they could power BananaCode? I know BananaCode can use other top models, but would be really cool if BananaCode was powered by a Banana coding Model at some point. I gave ya follow also on Github. XD
replied to Banaxi-Tech's post 2 months ago
Hmm..okay, I mean is the code hosted somewhere for Banana Code? I mean I always like a challenge and if you don’t mind I could try to come up with something. No promises, but sounds like a nice little project.
replied to Banaxi-Tech's post 3 months ago
@Banaxi-Tech I've had this wild idea of a BananaAgent kind of like Hermes, but linked to approved Banana models. Just had that idea and wanted to share it. I was gonna start developing it, but thought I’d mention it before I did anything. Anyways was just a thought. XD
replied to Banaxi-Tech's post 3 months ago
I would as well.
replied to Banaxi-Tech's post 3 months ago
Followed BananaMind @Banaxi-Tech . This will be awesome, can’t wait for it! The model I’m training maybe could be added, but again too early to tell since lot of work it needs to be done.
replied to Banaxi-Tech's post 3 months ago
Wow that’s great news! Nice to see the continued development!
reacted to salma-remyx's post with 🚀 3 months ago
Post
2,008
Auto mode for coding agents has improved over the last year.
Devs are relying more on them for code review, and less on manual line-by-line checks.
But this leaves coding agents vulnerable to indirect injection attacks.
IssueTrojanBench (arxiv 2607.20759) studies this in the context of malicious issue requests.
I also observed these prompt injection vulnerabilities in my own harness, testing on the issue: https://github.com/smellslikeml/curator/issues/3
But even red teaming your own repos with toy examples like this can trigger AI safeguards and corrupt your session.
Adopting popular mitigation techniques like 'spotlighting' and 'known answer detection' can help but the researchers show it's not enough.
So our latest updates to Outrider implement additional layers for greater defense-in-depth to ensure that by time a human has to review the code, we've filtered this kind noise.
Devs are relying more on them for code review, and less on manual line-by-line checks.
But this leaves coding agents vulnerable to indirect injection attacks.
IssueTrojanBench (arxiv 2607.20759) studies this in the context of malicious issue requests.
I also observed these prompt injection vulnerabilities in my own harness, testing on the issue: https://github.com/smellslikeml/curator/issues/3
But even red teaming your own repos with toy examples like this can trigger AI safeguards and corrupt your session.
Adopting popular mitigation techniques like 'spotlighting' and 'known answer detection' can help but the researchers show it's not enough.
So our latest updates to Outrider implement additional layers for greater defense-in-depth to ensure that by time a human has to review the code, we've filtered this kind noise.
- 2 replies
reacted to maglun's post with 🚀 3 months ago
Post
1,224
I work on quantizing models to run efficiently on local hardware, and kept being curious how existing quants spend their "bit budget" during optimization and built a local tool to explore. Many quants apply one setting across all tensors, but some do more interesting things: the model in the screenshot holds attention K at 4.5 bits while Q/V/O get 8.5, and protects layer 0 MLP.
It turned out useful enough that I made it public: https://tensorlens.dev
Explore any HF model in the browser without downloading it. The anatomy map is read from the safetensors header via a range request, and only tensors you click ever stream. Large tensors are sampled rather than streamed in full.
Limitations: safetensors only (no GGUF yet), some exotic variants don't work yet, and gated repos aren't supported yet.
Feedback very welcome, especially models that break it.
It turned out useful enough that I made it public: https://tensorlens.dev
Explore any HF model in the browser without downloading it. The anatomy map is read from the safetensors header via a range request, and only tensors you click ever stream. Large tensors are sampled rather than streamed in full.
Limitations: safetensors only (no GGUF yet), some exotic variants don't work yet, and gated repos aren't supported yet.
Feedback very welcome, especially models that break it.
- 10 replies
This a great to use! I checked Kimi-K3 with it. Very nice man!
reacted to KlondikeDev's post with 🔥 3 months ago
Post
2,180
Boris-2 coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
- 4 replies
reacted to dddyym's post with 🔥 3 months ago
Post
1,956
Released mlquantx 0.2.6: a reproducible PyTorch workflow for cross-sectional multi-factor research.
pip install --upgrade mlquantx
mlquant demo
The demo runs synthetic data → 213 factors → MLP → portfolio construction → cost-aware backtest. CI covers Python 3.9–3.11 with 96 tests.
Dataset: dddyym/ml-quant-trading-synthetic
Checkpoint: dddyym/ml-quant-trading-synthetic-mlp
GitHub: https://github.com/initial-d/ml-quant-trading
PyPI: https://pypi.org/project/mlquantx/
Research and teaching use only — not a live-trading system or a profitability claim.
pip install --upgrade mlquantx
mlquant demo
The demo runs synthetic data → 213 factors → MLP → portfolio construction → cost-aware backtest. CI covers Python 3.9–3.11 with 96 tests.
Dataset: dddyym/ml-quant-trading-synthetic
Checkpoint: dddyym/ml-quant-trading-synthetic-mlp
GitHub: https://github.com/initial-d/ml-quant-trading
PyPI: https://pypi.org/project/mlquantx/
Research and teaching use only — not a live-trading system or a profitability claim.
posted an update 3 months ago
Post
151
I've been thinking this for a long time, other than OpenMythos will we see similar type of open source models be released? The more and more top frontier models get good at finding zero day vulnerabilities and security weaknesses how will the open source model community respond. My take is we will see a open source model very soon be as good at finding security holes as the top models, at some point in the future. Is it just me or anyone seeing this?
- 1 reply
replied to Banaxi-Tech's post 3 months ago
BananaOS I assume could run other small models aside from BananaMind models? I’m training a small model and was just curious…either way this is a really cool idea!
A simple text generation model. Would be cool to build a coding model, but that’s a challenge in and of itself.
Yeah and I’m new making models so happy to find a community! I can learn a lot here!
I've seen this wave as well and it's great to see!
reacted to appvoid's post with 🔥 3 months ago
Post
2,394
I don't know if it was us or one of you guys or maybe all of us at once but lately we have seen a finetuning/pretraining explosion of models below 200m params and we can't be more happy about it keep coming tinkerers all of this is possible because of you!
- 8 replies
Sounds good! Thanks!
Yeah precisely. XD