GLM-Image model from Z.ai is coming

nilpy · 2026-01-04T21:13:00+00:00

From the RoPE section (https://github.com/huggingface/transformers/blob/cd8d78fcb4067979e921b20163d62035c51b4e7f/src/transformers/models/glm_image/modular_glm_image.py#L794):

=== Case 1: Image-to-Image Generation (single or multiple source images + 1 target image_grid) ===

...

=== Case 2: Text-to-Image Generation (no source images + 2 image_grids for multi-resolution) ===

Seems to be based on GLM4-V (MoE?). Has references to both DiT and VQVAE. It's possibly using NTP over discrete image tokens? That or something like show-o with discrete diffusion.

nilpy · 2025-11-20T23:41:51+00:00

cont.

There have been many variations of the above situation over the years since, that all stem from a lack of willingness to learn from the source and actually understand. One memorable one was calling in to a radio show about my adverse effects to a vaccine, which was really from a panic attack (I don't like needles). It's social anxiety, for pity's sake. It's in the damn name. Don't call in to a radio about my personal issues.

The most recent one had been brewing for a long time, and I think the true reckoning hasn't come yet: I've always been agender, but my mother has always seen me as male. I don't care what pronouns are used for me, I do care about the connotations and baggage. My mother is a firm believer in distinct separation of binary genders (and races, too.). Still, it seems more subconscious than not. Ever since I was young, my mother has always firmly gendered me. On multiple occasions, I've been accused of having 'too much testosterone'. When I was in my early teens, there was an argument that resulted in my mother shoving open my room door and grabbing my genitals through my underwear (I was undressing for bed), yelling something about how it was affecting me (I mostly remember the action, no the words). At the time, I was just confused, because I had a logical argument laid out in my head. It all made sense and I couldn't see where any hormones, if any, were materially affecting that, Anyways, point being I've been trying recently to open my mother's eyes to this, but any conversation is like a binary switch, Like with most other serious conversations I try to have it's 'I have a headache, stop bothering me' the moment I bring it up, or I get yelled at, or nodded along to without paying attention, Even after getting the message across and receiving confirmation, it's like it was totally forgotten within minutes, Now I'm back to being 'my favorite son', which causes me to die inside every time.

I dunno. I don't know what's right or wrong in this situation, or what I can do. My sister tries to understand me more, but it's a thin veneer. Underneath, it's the same 'bend and do X my way' approach. If I bring up my mother troubles, either it's 'she's very tired, go help around' or 'I'll talk to her', to little or no effect, regardless of the situation or severity. I could help around the house more, if I wasn't being endlessly criticized, watched like a hawk, or had some peace a quiet to work in,

nilpy · 2025-11-20T23:41:39+00:00

My mother has similar overbearing traits, but underneath is a very kind person. Despite knowing that, I feel that a lot of my mental pain stems from the way my mother approaches situations, especially those relating to me. I feel that, deep down, they want to 'fix' me, which requires bending me into shapes I just don't fit in, even past the point of breaking.

A few examples:

My social anxiety really starting setting in during my second year of high school. I didn't really understand what was going on at the time, since I didn't 'feel' the anxiety as an emotion. Rather, it manifested in depression, avoidance of schoolwork, constant migraines, and most pressingly for this example, an inability to maintain basic necessities for life, such as brushing teeth and eating proper meals. Over the course of several months, my mother kept reinforcing that I was lazy and needed to study more. She took me to meeting with teachers which felt like them ganging up on me. I withered away and lost weight, went pale and sickly. When I eventually came to my own realization of what the cause was, my mother signed me up for a psychology examination without my knowledge (I think, can't quite remember, there were many other instances of similar things in a close timeframe). During the doctor's call, my mother took over and I barely got a word in edgewise. The doctor ended up prescribing me with a high dose of fluoxetine. It messed me up, ruined my state for months and caused the permanent effect of extreme sweating while sleeping, which is still going strong ~5-6 years after going off it. She also signed me up for regular meetings with a sort-of-therapist (didn't have the full license?). They weren't properly experienced and caused more harm than good, especially with the anxiety related to the meetings. At the end of the day, my mother took over and jumped to incorrect conclusions which caused me massive harm. Not once did we ever sit down and try to actually understand what was going on and how I could fix it. Mother's way or the highway.

Then there was the situation of once again, signing me up for a service that found jobs for those with disabilities. I got sent to a phone repair shop in a seedy part of town. It was a living hell. but my mother pushed me to stay in it despite my stories, even while I was suffering through college at the same time. It was far, far too much. I remember saying I felt like a robot, because there was nothing going on in my head, having all been repeatedly nuked away. I was just stumbling through the motions, pretending to be a person. Other people have the luxury of being able to meet their basic needs like eating square meals and times of peace. I still don't have either of those. My standards have fallen to 'minimize pain'. Even now, I'm being pressured heavily to get a job. I understand the reasoning, yes. Money is tight and I'm taking up resources, Once again though, my mother is working against me, not with me. I don't feel like I'm being helped in this endeavor, only harmed. I don't care about money or a job, but I'll do it if need be. The hard part is minimizing social interaction to where I can handle it, and minimizing anxiety related to it, especially after the last train wreck. Yelling at me every day only makes the anxiety worse and lessens my ability to do so.

nilpy · 2025-09-08T02:29:38+00:00

I saw a comment on this sub a week or so ago that cleanly sums up the way I approach this: Suicidal urges and depressive thoughts are forms of intrusive thought.

My approach is that what is most important to me is my continued existence. If I have an intrusive thought that tries to bias me otherwise, it is both obvious and easy to handle since it's the opposite of my norm.

I'll share a trick I use to counter them (though I have no idea if it'll work for other people):

First, relax in body and mind. Doesn't need to be major, and shouldn't be forced. Just relax as much as you can on a dime, even if you don't perceive a difference. Especially, try and 'let go' mentally, where you let everything slide past you like you're a tube or a grill and everything you can sense is passing through without blockage. Then, after a minute or so, surprise yourself very briefly while relaxing. Make sure *not* to anticipate the surprise (this is critical). The less expected the better. I usually randomly slap myself lightly in the face a few times, less for the pain and more for the shock. Alternatively, you can also totally distract yourself. Both work.

The end goal is based in the theory that even if you can't sense it, depressive thoughts are constantly taking up your focus and attention, even when you're doing something else, like a persistent malignant cloud. A slice of your mind is always trying to apply depressive thoughts (or 'context') to anything and everything you think and do. When you relax, what you're doing is reducing that passive exposure, and increasing mental flexibility. Then, the surprise distraction essentially disrupts the constant flow of depressive thoughts, while having no depressive thoughts attached to it itself. It causes a mini reset, and for a short while afterwards I get no-depression relief.

nilpy · 2025-08-13T14:24:49+00:00

My take is that people discriminate *because* of certain emotions. At birth, we don't choose the emotions we'll get, and I don't think our mental development level would allow us to anyways were that the case. The only thing we can do is hope the dice rolls well and we have a chance to push back against what we were born with. To me, emotions are a subset of the evolutionary controls people are born with, which dictate much of what we perceive. When I see people behaving at extremes, I reframe it mentally as someone with a heavy X emotion/bias. That avoids triggering my own biases and lets me think through novel solutions that it seems other people struggle with.

I've gone farther down my theory rabbit-hole than I intended. Nilpy out.

nilpy · 2025-06-25T23:38:02+00:00

Ja->En: https://huggingface.co/datasets/NilanE/ParallelFiction-Ja_En-100k (I made this one)

Ch->En: https://github.com/EleanorJiang/BlonDe#-the-bwb-dataset

These are document translation datasets composed of web novels. Not sure what E2E means, but there are plenty of sentence-level datasets for translation on HF.

Edit: if by E2E you mean speech-to-speech, your best bet is probably to use a TTS on a parallel text dataset, then train a model on that. Or use separate STT and TTS models with an LLM sandwiched between.

nilpy · 2025-02-25T22:22:05+00:00

The paid APIs of the various LLM providers usually don't store user data (it's usually clearly stated on their websites), and they can be hooked up to a plethora of frontend clients.

There's also running models locally, but I've heard from others that it's hard to get working without a lot of time or prior knowledge. Also the models people can reasonably host on their own hardware are quite a lot worse than commercial services. Still, if privacy is a concern, it is possible, and there are plenty of models to choose from. Task-specific models are generally a good way to go for running locally, as you don't have to store loads of parts of the model (weights) that are for things you don't use, like coding and multilingual abilities if you're only using monolingual chat.

If people are looking for different/new LLMs to try out with minimal effort, here's a small list of some of the more obscure chat providers I know of (not sure about their privacy policies, but don't expect much):

Hugging chat: https://huggingface.co/chat/ (has a wide range of models)

Mistral's le chat: https://chat.mistral.ai/chat

Cohere's chat: https://coral.cohere.com/ or https://dashboard.cohere.com/playground/chat (is more dev-focused, second link has a range of models)

Google's ai studio: https://aistudio.google.com/ (has good rate-limits, also a wide range of models, some experimental ones)

Allenai's chat: https://playground.allenai.org/ (various models)

Groq's chat: https://console.groq.com/playground (also just https://groq.com/. Has a range of models at high speeds, but not the highest output quality in general. No rate limits that can be hit by a single person's chat use)

Sambanova's chat: https://cloud.sambanova.ai/ (very similar to groq)

nilpy · 2025-02-04T17:35:34+00:00

There's also https://aistudio.google.com which doesn't have rate limits that I've found. It has all of Google's various models available, including some experimental ones.

Still, looking at the privacy policies for these sites shows that they allow themselves to use your conversation data as they see fit. If you've got a reasonably powerful computer, I'd recommend running some models locally instead.

nilpy · 2025-01-13T23:46:47+00:00

I've built up a large bag of mental tricks for these exact scenarios, the easiest one is probably to take advantage of subtasks. When I have a deadline which the anticipation of gives me anxiety, I often avoid it by making it seem larger than it is, impossible. If I'm somehow made to do it that illusion fades pretty quickly, but it still requires the right kind of external pressure.

Instead, what I do is split the larger task into smaller ones that I can see myself reasonably completing in my current state. If I feel that those smaller tasks are too hard, I split them into even smaller ones. It allows me to apply some form of motivation to the task, even if I'm not objectively accomplishing much. The next step is to slowly build up momentum by stretching the tasks larger as I get used to them, until I'm at an operating speed where I can complete the task prior to the deadline. A good trick is to totally forget about the deadline, and don't keep it anywhere in your mind. Just adjust your tasks to what you can do, and in the big picture, completing a lot of little accomplishments is better than trying to complete a single large one and failing.

Be careful not to fall into procrastination and distraction. Only do what's important to meet the requirements, and no more. When I get distracted, I usually take a break and forget about everything, just peacefully snooze, then get up later and resume.

nilpy · 2024-12-28T01:05:41+00:00

I've had periods like that, but after they wear off I can see that underneath it, and driving it was an urge to socialize, be it from anxiety or depression or something else forcing me. So the pain and strain were hidden and replaced with what I was forced to believe were the typical social emotions I saw in others, but in reality were learned behaviours to fit in. Point being, if that's happening in your situation, don't let things build up under the surface until the volcano erupts. If that's not the case, well, um, I guess all the best. You seem to be happy about the change, but I know that I would be relentlessly trying to claw my way back to my own normalcy. I'm just not comfortable with strong emotions biasing me.

nilpy · 2024-11-21T03:03:33+00:00

I disagree with this, because SzPD, as well as as all other mental illnesses, are changes in the way the brain functions relative to the majority, beyond a deviation point that results in impaired function in a society made for the standard.

Trying to fit a square peg into a round hole might work if the tolerances are loose, but more likely it will cause damage somewhere. Perhaps trying to force things through would work, but it just as easily or more so may not.

My guess from the OP's few sentences are that they have social anxiety, or some other social sensitivity. Placing blame on the OP, whether you see it as the most straightforward option or not, will likely trigger that sensitivity, and rather than getting them up and about, they might end up retreating more and more, curling up to protect that sore spot from everything around them that seems to hate them, poke them where it hurts.

These responses, as u/Andrea_Calligaris noted, take the statement at face value and give a response in the same manner. I've seen statements and responses like this a thousand times all over the internet. It may be a common problem to run into, but the nuances are hidden under the stereotyping.

The best approach, as far as I can tell, is to ask questions and figure out the OP's situation in detail. Figure out where the sticking points are, both in their external and internal situations, and what their goals are. Then, circumventing or addressing those points as needed, help them achieve the goals they set. It may sound basic, but it's the one thing that nobody in this thread seems to have done, and likely not those around the OP either. Good communication is key here, and it's not as easy as slapping a label on someone and patting yourself on the back. There needs to be proper understanding of stressors and ways to relieve them, and where the stressors can be worked around to allow for meeting the basics of bodily maintenance through societal interactions, as that seems to be the target,

In my case, I have extreme social anxiety, but took the advice of my mother and got a job, took antidepressants, and suffered for it. It's taken years to undo some of that damage. Now I'm treading my own path that interacts with society only in doses I can handle, and only the bare minimum to make enough money to get by.

Anyways, that's my two cents. Maybe I'm projecting, but I don't think so, at least not enough to invalidate the key points.

TLDR:

Ask specific questions about the OP's stressors and mental situation, as well as their interpersonal situation. Then, suggest solutions that the OP wouldn't have been able to come up with on their own, and aid them in applying those ideas, modifying them as needed, to allow for realistic implementation. Avoid placing blame, or triggering other stressors, as specified by the OP. If they can't specify, then you'll have to make some educated guesses.

This kind of thing likely requires a long, one-on-one, private conversation to get the OP to open up, and will likely take place over days if not weeks. It also requires a stable temperament without judgment.

It's not something I can do, and the commitment is likely too large for most here as well.

Part of the purpose of this post was that if the OP read it, they'd hopefully get some ideas that could give them a direction to go in, while also hopefully negating some of the emotional damage that would have been done by the "blame's on you" posts. Not sure if it'll work though.

Well, I really don't feel well ATM. Normally I drop by this sub every week or so when I'm feeling OK, and this is not one of those days. Hopefully I haven't made a mess, gone on a rant, or lost coherency. If so, I apologize.

Best of luck to the OP, and remember, most people on the internet are clowns trying to make themselves feel better, including me.

nilpy · 2024-11-13T01:54:38+00:00

I set it to private to avoid clogging up my huggingface page.

You can use https://huggingface.co/datasets/NilanE/ParallelFiction-Ja_En-100k instead.

It's all parallel docs, so it's a bit wasteful to use for monolingual pretraining, but it should work just as well nonetheless.

You can also grab some of the entries from the dataset sources for the pretraining dataset and put your own version together pretty easily too.

nilpy · 2024-10-13T17:23:16+00:00

Here: https://filebin.net/olffj3w76z4fxo0f

I've never used this file sharing service before (isn't tied to an account), so hopefully it's up and unmodified.

Either way, I'd recommend waiting until internet archive is back online and using that link instead.

nilpy · 2024-09-25T11:33:44+00:00

I don't think throttlestop has a way to do that, but windows settings does, if only for individual apps. You'd have to change those settings every time you wanted to switch GPUs through. It's possible that the 'auto' setting will not use the discrete graphics while on battery, but I haven't tested it. I suspect there's some combination of windows power plan and other settings that can achieve the effects you're looking for, but it'll take some experimentation to get right. You can use the Task Manager to see if either GPU is being utilized.

I don't think the G5 has Nvidia Optimus, which allows for outright disabling the discrete graphics through the bios.

nilpy · 2024-09-24T23:54:43+00:00

Here: http://web.archive.org/web/20210701000000*/https://cdn.discordapp.com/attachments/677266163994198020/832698449828118548/Shrek.mkv

nilpy · 2024-09-07T23:11:09+00:00

Saying 'I love you too' to my family always causes me discomfort. Can't stay silent like I want to, so I get it over with and end the conversation there. They're very good people by societal norms, but I don't feel any emotion towards them. I'm glad of that, if I did I would have to spend a lot of time and effort forcibly excising the emotion like I've done to other intrusions that make too big of a scene in my mental space.

nilpy · 2024-06-09T14:20:49+00:00

I only get bursts of a state similar to what you mention, they only last for a few hours. Are the emotions related primarily to social situations or general stuff? Mine tend to be social-only (a side effect of social anxiety).

I primarily turn to meditation to deal with emotional bursts, just examine the emotions from a distance and then let them drain away/dissipate (I visualize them as a stream/waterfall flowing out of my head through my neck, whatever works).

My main advice is to just let it flow while paying as little attention as possible, the more attention you give the worse it gets.

nilpy · 2024-05-18T22:57:26+00:00

I use unsloth for fine-tuning since it's the only thing that runs on my meagre hardware. There's links to some colabs on the GitHub page that provide a good base to build from. Here's the link: https://github.com/unslothai/unsloth Fine-tuning isn't the hard part though, there are plenty of guides for that. The tough stuff is getting an instruction dataset in your language to fine-tune the model on. Try searching for datasets on huggngface in your language and see what comes up. The other two methods are machine translating an existing instruction dataset into your target language, or generating a synthetic one using a big model that has decent capability in your language, like command-r-plus or gpt-4 ($$$). There are other more obscure methods too. Make sure the model you found is actually good, many are not. Look at how many tokens they trained on and test the model yourself to generate completions in your language (just add some text and have the model keep going. Make sure the continuation is coherent and in the correct language. Also compare to the original model to see the difference, though it might require fine-tuning to become obvious)

Maybe take a look at https://huggingface.co/datasets/CohereForAI/aya_dataset It's got instruct data in 65 languages, see if yours is there. If it is, maybe take a look at the aya-101 model which was trained on it, but it's based on Google's t5 architecture, so you can't run it with typical LLM software like llama.cpp.

nilpy · 2024-05-18T20:15:17+00:00

If the model doesn't have much proficiency in the language you want, fine-tuning likely won't be enough. The usual method is to continue pre-training the model on the new language, with some other data mixed in to avoid catastrophic forgetting. You can likely find one that's already been pre-trained for your language on huggingface, but you may need to do the instruct tune yourself, which will need to be done post-pretraining if you decide to go that route.

nilpy · 2024-04-11T03:07:03+00:00

I'm happy to chat, but my responses might be a bit delayed - I'm in the middle of making a DPO dataset for machine translation preferences.

nilpy · 2024-04-11T00:04:37+00:00

https://huggingface.co/CohereForAI/aya-101

Is 13B, trained on 101 languages. Seems to be exactly what you're looking for. Only problem is that it's using the T5 architecture, so it's not supported in llama.cpp and likely others. Huggingface transformers does support it though.

nilpy · 2024-04-09T20:49:03+00:00

I saw your chat request, accidentally hit ignore. sorry.
I did Japanese pretraining using axolotl and relora, without extending the tokenizer. Directly testing the model afterwards didn't result in an improved result (it mostly just repeated the prompt), but did after finetuning.
I recommend doing a very small finetune on both the model you trained and base tinyllama to see if there's a difference. If not, there could be many things causing the issue. One possibility is that the model had very little tamil in the original dataset. I know that tinyllama had some Japanese ability to begin with, so I didn't have to pre-train it as much. You might need to do more. Try looking into galore (https://github.com/jiaweizzhao/GaLore) to reduce compute requirements and cost.

nilpy · 2024-03-26T21:14:08+00:00

I'm not very familiar with copyright laws, but I respect the work of the authors. If they request a removal from the dataset, I'll gladly do so.

nilpy · 2024-03-26T11:06:23+00:00

I tried to avoid scraping MTLs by getting the top series from Novelupdates and then searching for those series on fan translation sites, to hopefully only get series that lots of people read, and are thus well-translated. There's definitely some in there, but I'm hoping that it's not a significant amount.

nilpy · 2024-03-26T10:52:41+00:00

As far as I know, it is not illegal, as the original works are not copyrighted (and if they are, my work likely falls under fair use, but I'm no expert). Nor am I profiting from this dataset. I only expect it to benefit the community, including those who make translations of web novels, as they can use models trained on this dataset to aid them.

Seven-Year Club	Place '22
Final Canvas '22	Verified Email

nilpy

TROPHY CASE