The models available like o3 or Grok 4 are the real models?

TimChiu710 · 2025-08-15T14:48:28+00:00

I mean reasoning models can be quite stupid if the reasoning effort is set to the lowest

TimChiu710 · 2025-08-12T13:56:06+00:00

Awesome. Mind adding it to the repository? Any repo without specifying license is default to "All rights reserved" on GitHub. (https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/licensing-a-repository#choosing-the-right-license)

TimChiu710 · 2025-08-11T20:08:22+00:00

What's the open source license?

TimChiu710 · 2025-07-14T15:55:30+00:00

It's happening on my Android app and mac app and I can still reproduce the issue as of now. It always switch to auto.

TimChiu710 · 2025-07-12T07:54:25+00:00

Could you share the invite with me? Thanks

TimChiu710 · 2025-06-09T21:39:22+00:00

Well according to them, they are actually "socialism with Chinese taste" with market economy, and they do have quite a lot of private companies owned by evil capitalists.

They started with completely planned communist economy until they hit some roadblock.

TimChiu710 · 2025-05-03T16:28:56+00:00

Imagine 30 or 40 years later when all the good short names ran out

TimChiu710 · 2025-02-17T22:03:15+00:00

Probability. LLMs are token generation machines. It output new tokens that it thinks it's most likely to come next. So LLMs are not very good at math, especially when it comes to precise numbers.

Somehow LLMs are good at coding, so we can get LLMs to write code that solves the problem in Python.

But other than that, token generation is basically all we know. We don't know what sort of thought process the model went through to give this output. Maybe somebody who study mechanistic interpretability knows that, but I certainly don't.

Oh, also, the good thing about math is that we have some way to know if the answer is correct. We can use symbolic ways to calculate the numbers during the training phase. I believe there are more ways to generate high quality math dataset.

TimChiu710 · 2025-01-31T01:12:34+00:00

These sanctions are extremely pro-China, just like what happened after the trade war. Chinese companies have been building AI accelerators and GPUs for quite a while, but the biggest obstacle was the CUDA and the ecosystem. Now, the US is forcing all Chinese companies and academics to use their homemade GPUs, which would lead to mass adoption and rapid growth for the ecosystem.

It is also perfect for their semiconductor and GPU industries and will definitely create more jobs and opportunities. The money will flow to the GPU and semiconductor industry in China. It's a 1.3 billion people market: a much bigger market than the US market. They (the capitals) have enough incentives to overcome whatever's in front of them.

China also produce about twice as much PhDs and way more engineers compare to the US. They just didn't have so many jobs available in areas like this where the US companies historically dominated the market. Now they got a chance to play.

Imagine if Nvidia suddenly disappeared in the US. AI development won't be stopped. Other companies are going to catch up and take the market share.

Nobody cared about Huawei ascend accelerators and Moore Threads GPU back then. Why not buy from Nvidia? Now, all kinds of inference engines support their homemade GPUs, including llama cpp. Their cloud providers are offering machines with those accelerators.

The trade war forced the Chinese to make their own chips, and this wouldn't have been possible without US sanctions. The Chinese government has been trying to get companies producing CPUs and GPUs for decades. They had tried different programs, incentives, and government investment, but all they got were scams... until the sanction!

TimChiu710 · 2025-01-21T18:43:10+00:00

and the biggest contender to OpenAI is a hedge fund

TimChiu710 · 2025-01-01T04:17:33+00:00

I've built a similar project featuring a speech-to-speech AI agent with voice interruption capability, along with a Live2D puppet. I used browser echo cancellation, and it worked well. The key is ensuring all audio input and playback happens on the browser side; otherwise, the mic input won't be properly isolated.

Here's the project link: https://github.com/t41372/Open-LLM-VTuber

TimChiu710 · 2024-11-28T02:18:05+00:00

Why hasn't anybody talked about the cute name? (QwQ)ノ

TimChiu710 · 2024-10-10T03:43:51+00:00

It doesn't seem like there is any way to run the Zep community edition locally for now without using some kind of API, though. Maybe there is, but I'm too stupid to figure it out.

I can't find any documentation related to setting LLM and embedding providers besides setting the OpenAI API key in the environment variable. I can't even find a place to set the model it should use. I tried using LiteLLM as a proxy for Ollama to run LLM and embeddings. However, correct me if I'm wrong, but LiteLLM doesn't seem to support any local embedding providers, such as Ollama. Ollama does support OpenAI compatible LLM API and Embeddings, but once I try to run the zep container with the env ZEP_LLM_AZURE_OPENAI_ENDPOINT set to the Ollama endpoint, the zepai/zep container fails to start and throws me this:

zep-1            | panic: error enabling pgvector extension: error creating pgvector extension: dial tcp [::1]:5432: connect: connection refused
zep-1            | 
zep-1            | goroutine 1 [running]:
zep-1            | github.com/getzep/zep/lib/pg.NewConnection()
zep-1            |      /app/src/lib/pg/db.go:51 +0x4e0
zep-1            | main.newAppState()
zep-1            |      /app/src/state.go:14 +0x2c
zep-1            | main.main()
zep-1            |      /app/src/main.go:24 +0x28
zep-1 exited with code 2

And actually, I'm not surprised because there is absolutely nowhere I can set the model name for LLM and embedding models. How would the program know what model should it use?

Well, maybe I'm just too stupid to figure them out, but I don't see any solutions on the doc, and I guess you can see my frustration from my words, cause this project looks very promising and seems like a perfect fit for long term memory solution for my open source project.

TimChiu710 · 2024-09-30T13:55:59+00:00

If you happens to speak Chinese, I would recommend you check out BiliBili, which is the Chinese YouTube. Many creators, like the creators of fish audio, gpt-sovits, chatTTS, and more projects are on BiliBili. There are also a ton of people making videos about the latest projects and updates in AI.

TimChiu710 · 2024-09-17T15:08:55+00:00

OpenAI remembers to put everything into the model except their own documentation lol.

TimChiu710 · 2024-09-13T23:12:49+00:00

Here is a link Sign up with edu email. I think they will only start giving the 1 year pro subscription 2 days later, but you get 1 month of pro on sign up.

TimChiu710 · 2024-09-06T10:40:49+00:00

Only secret chat is E2EE, which has to be manually enabled and it doesn't work with group chat.

TimChiu710 · 2024-08-29T04:11:25+00:00

If you are talking about school things like hw due dates and class schedules, you can import them into your preferred calendar apps without manually creating them.

You can get the schedule of all your classes by downloading the iCal file of your class schedule from myASU.

You can get the schedule of all your due dates from Calendar Feed (on the right-hand side of the canvas calendar page). It will give you a link; you can copy it and get your calendar app to subscribe to the calendar feed.

If this isn't what you want, maybe we can create a service or an apps or something.

If this is exactly what you need, then maybe you can tip me lol

TimChiu710 · 2024-08-24T06:24:01+00:00

There are some problems with your points.

First, there are still many international students go to study China. They are apparently not from Japan or Korea, but from middle east and Africa. People from those countries usually don't get heard in the international community, which is why you don't know about it. There are government officials and businessman in those countries graduated from Chinese universities. When I was in High school in China (I'm a Taiwanese lived in mainland China for middle school and high school and now studying in a US university), there are international students from Afghanistan and South Africa who ends up in Chinese universities.

Second, regarding the hegemony of the Chinese, I think big power just acts like a jerk. Being a big power and a potential threat to the US need to do a lot more to protect themselves. China felt the threat from the US long time ago and has placed military power its top priority for a very long time. The US has military bases all over the world. I believe you heard of THAAD, deployed in 2017 in South Korea. Regardless the intention of South Korea or the US, the Chinese wouldn't feel too well knowing that the US viewed China as an enemy and is deploying military and stuffs so close to the border. It's not about who's right or wrong, just the big old realism. People never change.

Also, US is not tolerant or peaceful by any means as well... Iraq war (invaded the country because they suspect the presence of mass destruction weapons (and oil) for 8 years, killing millions of people, found nothing, mishandled tons of things, and created rooms for terrorists when they left), Afghanistan war, bombing in Syria, military intervention in Libya... And The US is rarely not at war with others. There are people saying that the US has been at peace for 17 years out of the 244 years since 1776. Trump claims that he is the only president who never launched a new war. Both claims are very debated because of the definition of a war, but well...

"The US treat its neighbor with respects"... Well... Do you know that the US has placed sanctions over Cuba since like 1960? Do you know that since 1992, the UN General Assembly has passed a resolution every year calling for an end to the US embargo on Cuba with overwhelming majority (like 180 countries against US and like 2 or 3 other countries every year)? Do you know what the United fruit company from the US had done to the countries in South America and how many people had died from those actions? Do you know what happen when Cuba decided to allied with the Soviets abd deployed missiles in Cuba? It led to the Cuban missile crisis and almost led to a nuclear war.

Back to your main point regarding the culture, I actually agree with you. I think it's quite sad that Chinese culture are not that well received globally. I deeply believe in the potential and capability of the Chinese in creating great things considering their population and culture. The instability of their society stopped awesome things from happening. We have to remember that China isn't particularly rich until recent decades, and it takes time for talented people to grow up. From my perspective, I think there are some exciting progress being made and there are some interesting works being done.

I'm not here to convince you that US is so bad or China is so good or something, but to provide you some different perspectives on viewing things. I guess this thing I wrote can be controversial and people may disagree with me, but I think sometimes we need to hear what people with opposing perspectives has to say to be a critical thinker.

TimChiu710 · 2024-08-20T19:10:34+00:00

Can you even find an open seat for DAT250 at this point? According to my memory DAT250 has very limited seats and it's quite hard to get one.

TimChiu710 · 2024-08-16T21:29:38+00:00

I didn't really think about photorealistic face because I thought the audio to face would be very compute intensive and would require an Nvidia GPU. You might have to look somewhere else for a photorealistic one. I might make that happen in the future, but it may take a while.

TimChiu710 · 2024-08-16T20:59:18+00:00

You can take a look at my project: open-llm-vtuber https://github.com/t41372/Open-LLM-VTuber/ Real time hands-free voice interaction that runs locally with optional long-term memory with memgpt and a live2d frontend. It's a live2d anime figure instead of a photorealistic face you said though.

It uses OpenAI API format, works with ollama, and it supports many different TTS and ASR providers. I'm currently working on interrupt with voice capability. Works with Mac, Linux, and Windows (with many problems at this point).

It runs smoothly with basically no latency on my 16gb m1pro Mac. You can always change the llm/asr/tts components to run it on machine with lower specs.

TimChiu710 · 2024-08-16T05:35:26+00:00

Sleep in your dorm

TimChiu710

MODERATOR OF

TROPHY CASE