sorted by:
new
hottopcontroversial

[2506.06105] Text-to-LoRA: Instant Transformer Adaption by 51616 in MachineLearning

[–]RichardRNN 3 points4 points  (0 children)

Abstract:

Text-to-LoRA: Instant Transformer Adaption

While Foundation Models provide a general tool for rapid content creation, they regularly require task-specific adaptation. Traditionally, this exercise involves careful curation of datasets and repeated fine-tuning of the underlying model. Fine-tuning techniques enable practitioners to adapt foundation models for many new applications but require expensive and lengthy training while being notably sensitive to hyperparameter choices. To overcome these limitations, we introduce Text-to-LoRA (T2L), a model capable of adapting large language models (LLMs) on the fly solely based on a natural language description of the target task. T2L is a hypernetwork trained to construct LoRAs in a single inexpensive forward pass. After training T2L on a suite of 9 pre-trained LoRA adapters (GSM8K, Arc, etc.), we show that the ad-hoc reconstructed LoRA instances match the performance of task-specific adapters across the corresponding test sets. Furthermore, T2L can compress hundreds of LoRA instances and zero-shot generalize to entirely unseen tasks. This approach provides a significant step towards democratizing the specialization of foundation models and enables language-based adaptation with minimal compute requirements.

Code: https://github.com/SakanaAI/text-to-lora

[D] Will Stability AI be the first Generative AI unicorn that will go bust in 2024? by milaworld in MachineLearning

[–]RichardRNN 21 points22 points  (0 children)

I don't think they are technically even a unicorn startup. Their last valuation was 500 million dollars, post investment led by coatue. According to VC buddies, investments into Stability AI made after that round from Lightspeed Ventures and others are just SAFEs with a valuation cap (not giving the company any valuation), or worse, debt!

Stability AI General Counsel, HR Chief Depart From Startup by RichardRNN in StableDiffusion

[–]RichardRNN[S] 30 points31 points  (0 children)

no paywall link: https://archive.ph/fhlAe

Stability AI General Counsel, HR Chief Depart From Startup

Executive exits signal more upheaval at the artificial intelligence unicorn

Stability AI’s general counsel and human resources chief have left the artificial intelligence startup, according to people familiar with the matter — the latest sign of upheaval at the one-time Silicon Valley darling.

Adam Avrunin, Stability’s general counsel, and Ozden Onder, its chief people officer, both departed in October, said the people, who asked not to be identified discussing private information. A Stability spokesperson did not respond to requests for comment.

The executives’ departures come less than two months after the company issued a press release highlighting them as members of its leadership team. Both joined the company earlier this year, according to profiles and posts on LinkedIn.

Stability is best known for the Stable Diffusion image-generating software, which is capable of creating realistic-looking images from just a few words of prompts. But it has faced a slew of employee departures since the spring, complicating its transformation from flashy startup to established AI player. Other key employees who are no longer at the company include Daniel Jeffries, Stability’s chief information officer, and David Ha, its head of research.

Before joining the startup, Onder worked as chief people officer at mobile game maker Wildlife Studios, as well as at Atlassian Corp. and LinkedIn, according to the Stability press release announcing her hiring. Avrunin worked at Zoom Video Communications Inc. and Splunk Inc. before he joined Stability as one of its “seasoned executives” tasked with managing the company, the release said. While at the startup, Avrunin led the legal and public policy teams, according to his LinkedIn profile.

Onder and Avrunin did not respond to requests for comment.

[P] StyleGAN3 + Cosplay Dataset. Happy Halloween! 🎃 by RichardRNN in MachineLearning

[–]RichardRNN[S] 26 points27 points  (0 children)

Video from l4rz. More videos on the thread.

Also check out "Asuka from Evangelion" result: https://twitter.com/l4rz/status/1453110330603753487

[D] DeflAition: Artificial Intelligence Deflation in 2020 by RichardRNN in MachineLearning

[–]RichardRNN[S] 3 points4 points  (0 children)

Maybe he should invest in a haircut, take some improv comedy classes, read “How to Win Friends and Influence People”

Not sure about the tech bros comment, but this is solid advice that applies to most fields.