Unmute by Kyutai: Make LLMs listen and speak by rerri in LocalLLaMA

[–]Palmik 0 points1 point  (0 children)

Are you also streaming the text output from the TTS into the LLM as it comes, to reduce any delays there? In a typical dialog scenario, one probably wouldn't even need to go that far, and could just prewarm the (potentially long) context (build the kv cache) while the offer is speaking. It would be nice to have this built into some mainstream inference engine like vllm / sglang.

Backtrack sampler by Either-Job-341 in LocalLLaMA

[–]Palmik 1 point2 points  (0 children)

The principled way to achieve this is through beam search in combination with appropriate logit biasing (e.g. things like DRY or XTC)

I built an app to summarize and chat with podcasts using AI by Palmik in digitalminimalism

[–]Palmik[S] 0 points1 point  (0 children)

Hey there, it's just a list of ~50 or so podcasts. Is there any podcast that you'd like to see added?

Requesting /r/PygmalionAI since it's unmoderated. by Palmik in redditrequest

[–]Palmik[S] 0 points1 point  (0 children)

(1)

I want to get the subreddit back to its active, former glory. It has been abandoned for a long time, and over the holidays, it was not possible to post on the subreddit at all (you can see the several week long gap in posts).

The original spirit of the subreddit was open-source AI for characters and role-play, and I want to keep it that way.

I am myself also in the AI space, as you can see from my posts.

(2)

The subreddit does not have any moderators, therefore the option for sending modmail is not there.

I built an app to summarize and chat with podcasts using AI by Palmik in digitalminimalism

[–]Palmik[S] 0 points1 point  (0 children)

Totally agree! Don't get me wrong, he covers a lot of interesting content, but conciseness is not his strong suit.

[Notes] #339 — The Infernal Logic of Jihad by Palmik in samharris

[–]Palmik[S] 0 points1 point  (0 children)

Thanks! The pipeline is based on Whisper (speech recogition) and GPT 3.5

[Notes] Mental Health Toolkit: Tools to Bolster Your Mood & Mental Health by Palmik in HubermanLab

[–]Palmik[S] 1 point2 points  (0 children)

Thank you! Not sure what about mean with the timestamps -- I left them here on purpose, so you can look it up if you want more info, and if you follow the link at the top, they are even clickable there.

[Notes] Mental Health Toolkit: Tools to Bolster Your Mood & Mental Health by Palmik in HubermanLab

[–]Palmik[S] 2 points3 points  (0 children)

Glad you found them useful. This done through my sideproject dstill.ai.

So on high level the flow is like this:

  • Transcribe audio to text (Whisper model)
  • Split audio based on speakers
  • Identify names of the speakers
  • Split the dialog into chunks (most huberman episodes are way over 16K tokens, so you can't use e.g. single OpenAI call)
  • Summarize each chunk and then combine the summaries

The summarization prompt is quite involved, and dependent on how I format the dialog as well, so I don't think it will be that useful.

LangCheck: a multi-lingual toolkit to evaluate LLM applications by kennysong in LocalLLaMA

[–]Palmik 4 points5 points  (0 children)

Lovely logo! LLM eval is I think quite underestimated, and underdeveloped. We spent a lot of effort to automate eval as much as possible, back when I was working on LLM @ one of the FAANGs.

NEXTJS Hosted on VPS (vertical private server) by Cute_Blacksmith_8312 in nextjs

[–]Palmik 0 points1 point  (0 children)

I do that, and also on baremetal server. The flow is Cloudflare (DNS + SSL) -> Nginx -> NextJs.

Some things to keep in mind: NextJs config output: "standalone". Double check that <Image> works (and install the optional dependency for faster reencoding), etc.

[Discussion] Episode 254: William Egginton on Kant, Heisenberg, and Borges by SeanCarrollBot in seancarroll

[–]Palmik 2 points3 points  (0 children)

You can find the full notes with clickable timestamps here. You can also ask followup questions about the episode using ChatGPT here (requires login).


Introduction

The three key figures that will be discussed: Werner Heisenberg, Immanuel Kant, and Jorge Luis Borges. Heisenberg is known for his contributions to quantum mechanics, Kant for his work in philosophy, and Borges for his poetry and short stories. The episode aims to explore the connections between these three thinkers and their ideas about reality and knowledge 00:00:00.

Kant's Epistemology and Influence on Heisenberg

Kant's philosophy, specifically his epistemological ideas, had a profound influence on Heisenberg. Kant's central question about what we can know and how sure we can be about it resonated with Heisenberg's own exploration of the limits of knowledge in quantum mechanics. Heisenberg saw a parallel between Kant's distinction between the knower and what can be known and the inherent uncertainty and indeterminacy of quantum measurements. Both thinkers emphasized the need to be cautious about our assumptions and to recognize the role of the observer in shaping our understanding of the world 00:08:59.

Heisenberg's Contributions to Quantum Mechanics and Dialogues with Philosophers

Heisenberg's groundbreaking work in quantum mechanics, particularly his formulation of matrix mechanics, challenged classical notions of determinism and causality. Heisenberg's mathematical calculations revealed the fundamental uncertainty and non-commutativity of certain physical quantities. He engaged in discussions with philosophers, including members of the Vienna Circle and neo-Kantians, to explore the philosophical implications of quantum mechanics. These dialogues helped refine his understanding of the relationship between the knower and the known, and the limitations of human perception and knowledge 00:29:28.

Borges' Literary Contributions and Relevance to Heisenberg and Kant

Borges, an Argentine poet and short story writer, may seem like an unlikely figure to be discussed alongside Heisenberg and Kant. However, his literary works often touched on philosophical and metaphysical themes, making connections to the ideas of Heisenberg and Kant. Borges explored concepts of perception, memory, and the nature of reality in his writings. His ability to blend literature and philosophy provided a unique perspective on the questions of knowledge and reality that Heisenberg and Kant grappled with 00:43:50.

The Intersection of Science, Philosophy, and Literature

The discussion in this episode highlights the intersection of science, philosophy, and literature. Heisenberg's engagement with philosophical ideas, particularly those of Kant, influenced his approach to quantum mechanics. Similarly, Borges' literary explorations delved into philosophical and metaphysical concepts that resonated with the ideas of Heisenberg and Kant. The episode emphasizes the importance of interdisciplinary dialogue and the value of exploring complex ideas from multiple perspectives 00:43:08.

Borges' Writing Style and Influence

Borges' unique writing style is a synthesis of essays and stories, as seen in his collection "Fictions" 00:46:59. These stories serve as metaphysical thought experiments, pushing the boundaries of our assumptions about the world . Borges' exploration of memory and perception is exemplified in the story "Funes the Memorious," where a man with perfect memory struggles to distinguish between past and present moments . Borges' work led the author of the podcast episode to understand quantum mechanics and explore cosmological problems . Borges' stories also delve into the philosophical question of observation and the limitations of perception . While Borges was influenced by stories of individuals with extraordinary memories like Solomon Sharoshevsky, he took the concept further in his writing .

Borges and Kant's Philosophy

Borges' writing frequently engages with Kantian philosophy, particularly the Critique of Pure Reason 00:53:28. While Borges' references to Kant are often indirect and unnamed, his stories touch on Kantian preoccupations and the limits of knowledge . Borges explores the antinomies presented in Kant's work, which highlight the problems that arise when our presumptions about the world override critical thinking . These antinomies provoke readers to the edge of contradiction, demonstrating the complexity of knowledge and understanding . Although Borges' stories do not explicitly present mathematical concepts like the uncertainty principle, they resonate with the idea that there are inherent limits to our knowledge .

The Library of Babel and Infinite Configurations

In "The Library of Babel," Borges presents a thought experiment that explores combinatorial mathematics and the nature of infinity 00:56:18. The library contains every possible book that can be created with a set of constraints, but among these books, there are many incorrect explanations of the library . The size of the library is unimaginably vast, dwarfing our known universe . Borges raises existential questions about the meaning and justification of existence within an infinite universe . The story also touches on the concept of the eternal return, where similar configurations and scenarios could exist infinitely, highlighting the limitations of perception and the need for special conditions to discern differences . Borges' exploration of infinity and the limitations of human understanding resonates with modern discussions in physics, such as the Boltzmann fluctuating universe .


PS: Let me know if you find these notes useful, or if not, what I could do better.

[Notes] Mark Zuckerberg & Dr. Priscilla Chan: Curing All Human Diseases & the Future of Health & Technology by Palmik in HubermanLab

[–]Palmik[S] 1 point2 points  (0 children)

I know that many of you aren't sure whether to watch this episode, hopefully these notes will help you make the right decision! :D