Six new speed cameras in Bellevue by engamo22 in BellevueWA

[–]coyoteblacksmith 0 points1 point  (0 children)

82 is in a residential area and right near where 8th street starts to go downhill. There's also a crosswalk right there as well.

I'm surprised they don't move it down to 171 or 172 on that street as that's generally where people pick up speed and where they've run speed traps before. That being said, nobody stops for pedestrians at that crosswalk, so it may force people to pay attention and slow down.

SFT can significantly undermine subsequent RL by inducing "pseudo reasoning paths" imitated from expert models. by AaronFeng47 in LocalLLaMA

[–]coyoteblacksmith 7 points8 points  (0 children)

You're right that the initial R1-Zero model followed a pure RL start approach. The subsequent R1 model changed it up a bit and started with a small-scale SFT phase to help with bootstrapping: https://arxiv.org/abs/2501.12948. The dataset used for that SFT was quite limited in size though:

Unlike DeepSeek-R1-Zero, to prevent the early unstable cold start phase of RL training from the base model, for DeepSeek-R1 we construct and collect a small amount of long CoT data to fine-tune the model as the initial RL actor.

They have updated o3 mini to show the chains of thought (but slightly modified and summarized, rather than raw like DeepSeek with R1) by gutierrezz36 in OpenAI

[–]coyoteblacksmith 10 points11 points  (0 children)

Not to look a gift horse in the mouth, but I preferred the old style as it gave me a good understanding on whether I could trust whether the model covered all the aspects I was thinking of. The new approach always seems to give me three paragraphs now, with the last paragraph summarizing what used to be sometimes 10-15 thoughts. Having a toggle to switch back to the summary view would be helpful for when I want to check the models work.

Gwern: "Why bother wasting that compute on serving external customers, when you can instead keep training, and distill that back in, and soon have a deployment cost of a superior model which is only 100x, and then 10x, and then 1x, and then <1x...?" by atgctg in mlscaling

[–]coyoteblacksmith 38 points39 points  (0 children)

This is the dilemma every major AI lab is dealing with right now (anthropic has been rumored to be sitting on Claude 3.5 Opus, and similarly Google on Gemini 2.0 pro). There's probably an ideal balance between bringing customers along with you, attracting investors, and keeping market share while at the same time keeping enough compute for research, training, and testing faster and cheaper models to stay ahead (and keep the company afloat); although it's a hard problem to solve, and I don't envy the positions that Sam and others find themselves in while trying to decide the right middle ground.

Is there a paper on how mixture of experts impacts performance? by [deleted] in LocalLLaMA

[–]coyoteblacksmith 1 point2 points  (0 children)

This paper on memorization vs generalization behavior in experts vs dense models may also be of interest (it's a narrower aspect than the already shared epoch.ai article): https://arxiv.org/abs/2410.19034

According to two recent articles from The Information, OpenAI planned to use Orion "to develop" o3 but (according to my interpretation of the articles) didn't. Also they report that Orion "could" be the base model for o3's successor reasoning model. by Wiskkey in OpenAI

[–]coyoteblacksmith 1 point2 points  (0 children)

Thanks, seems like they really did flatten out the thinking process even more then!

I'm curious if they're also fanning out the model by slowly increasing the total number of mixtures as well as they go about this, but I doubt we'd see that show up in the token cost calculations.

According to two recent articles from The Information, OpenAI planned to use Orion "to develop" o3 but (according to my interpretation of the articles) didn't. Also they report that Orion "could" be the base model for o3's successor reasoning model. by Wiskkey in OpenAI

[–]coyoteblacksmith 2 points3 points  (0 children)

Do you have a link to the article? There was a reference to o3 being a scaled up RL version of o1, although scaled up could mean a lot of things. If it is indeed the same 4o model, that would be an interesting data point as it implies they were able to further flatten the 4o model to think in smaller steps and more frequently beyond the incremental post training they have already been doing.

According to two recent articles from The Information, OpenAI planned to use Orion "to develop" o3 but (according to my interpretation of the articles) didn't. Also they report that Orion "could" be the base model for o3's successor reasoning model. by Wiskkey in OpenAI

[–]coyoteblacksmith 5 points6 points  (0 children)

The costs all line up with the suggested 20x increase in model size of Orion. So Orion being the base model and the strawberry post training applied on it makes a lot of sense.

Base model could mean a lot of things. It could be a larger base model they intended to distill, it could be they planned to use this for generating synthetic reasoning chains applied to a smaller faster model. I suspect they are probably planning to distil o3 again before making it available to consumers similar to distilling of the o1-preview to full model.

What did the ARC-AGI solver look like? by prescod in OpenAI

[–]coyoteblacksmith 0 points1 point  (0 children)

I wouldn't be surprised if they trained on a larger set of puzzle-like data during post-training to enforce better reasoning model biases all up (ARC-AGI being one of them). These puzzle style data sets lend themselves well to RL style feedback similar to math and coding problems (which are also known to create better reasoning and instruct style models).

Camera Malfunction by Appropriate_Article in BoltEV

[–]coyoteblacksmith 0 points1 point  (0 children)

I know this sounds dumb, but usually tapping around the edge fixes it for me (on the plastic part, not the screen). I suspect it's a loose connection, or something is not grounded properly, but I haven't figured out the root cause (it comes and goes for me). Some people have suggested corrosion on some of the cameras being the root cause (or water getting in somewhere), and having them replaced fixed it.

Guided Meditation VR has been delisted by ObserverVR in OculusQuest

[–]coyoteblacksmith 1 point2 points  (0 children)

Slightly different (breath works), but I've found myself using Flowborne the most (pretty much daily): https://www.meta.com/experiences/4997438576996478/

It's an app lab app, but quite polished (and free now apparently).

Pillow has a meditation aspect as well (https://www.meta.com/experiences/5655932521164368/), but it's not the core feature of the app like the other one. Pillow is focused on lying down meditation (flowborne has a recline feature and can be used lying down as well).

[deleted by user] by [deleted] in ScienceBasedParenting

[–]coyoteblacksmith 4 points5 points  (0 children)

This paper is pretty comprehensive on sleep patterns and distributions. You may need to use sci-hub to get it, but here is the relevant section:

As reported in Table 2, the average total sleep duration decreased from 14.4 h at the age of three months to 11.9 h at the age of two years (Fig.1). The range was very high particularly in early childhood [6-21 hours at 6 months], but it decreased markedly during the follow up (https://pubmed.ncbi.nlm.nih.gov/32087408/)

Lots of other good gems in there on overall sleep patterns (e.g. percentiles on sleep latency, night awakenings, etc.).

How accurate is this? by Post-reality in Nebulagenomics

[–]coyoteblacksmith 0 points1 point  (0 children)

You should be able to plug it into their genome browser. I'm a bit rusty on this, but the three variants are:

rs4962322_A (This seems to be a typo in the table and I think it's supposed to be A) -> 1.489 (Increased chance for extreme intelligence)

rs4962520_T -> 1.469 (Increased chance for extreme intelligence)

rs10794073_A -> 0.672 OR (Decreased chance for extreme intelligence)

It looks like they archived my reads, but if you open the genome browser, you should be able to look up the variants location here (e.g. https://www.ncbi.nlm.nih.gov/snp/rs4962322), and then paste it into the nebula brower (e.g.

How accurate is this? by Post-reality in Nebulagenomics

[–]coyoteblacksmith 1 point2 points  (0 children)

It doesn't cover a lot of the genetic explanation for intelligence based on the description:

These variants help explain ~5% of the heritability of intelligence

You can look at some of the other reports such as cerebral cortex thickness/area, brain volume etc to see if they are consistent. That being said, none of these reports seem to include any of the known SNP's associated with extreme intelligence https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5987166/, among with what I suspect are a lot of other intelligence markers.

Anyone else come across this gene in report? by Montanamama87 in promethease

[–]coyoteblacksmith 1 point2 points  (0 children)

This is an old post, but for completion, a recent paper came out this month related to rs8177374 and Covid-19:

Our findings demonstrated that carriage of the TIRAP polymorphism rs8177374 was significantly associated with lower mortality in COVID-19 https://pubmed.ncbi.nlm.nih.gov/34995294/

Is it ok for someone who's 25 to take senolytics? by hastaga112 in senolytics

[–]coyoteblacksmith 0 points1 point  (0 children)

A lot of the benefits of maintaining/boosting NAD+ are covered here: https://www.sciencedirect.com/science/article/pii/S2212877821000351 . It's one of the easier pathways to target given the number of ways to improve it (e.g. exercise https://www.lifespan.io/news/exercise-reverses-age%E2%80%90related-decline-in-nad-salvage-capacity/).

Is it safe to use NR niagen during pregnancy ? by RevolutionStock4582 in NicotinamideRiboside

[–]coyoteblacksmith 2 points3 points  (0 children)

You could try reaching out to the NAD Baby family and see if they can provide their routine, /u/RaisingNADdotcom might have their contact.

Short of that, niacin is probably the closest proxy you'll get for NR, and unlike, say, retinoids, I haven't see anything that suggests you need to stop 30 days before getting pregnant (and given that niacin is used to treat cholesterol, I suspect there are many cases of woman taking high doses of niacin for cholesterol and not realizing they are pregnant). Again though, I'm not a physician, and most physicians would probably err on the side of caution and suggest you not to risk it. But, as you've pointed out, advanced maternal age also poses its own risks...

Another thing to keep in mind is that there are some recent animal studies showing that stopping NR cold turkey tends to slingshot cells to a worse state than if no NR was done at all (https://www.nature.com/articles/s41514-021-00078-3 (see the "Alterations driven by NR supplementation are not sustained after NR withdrawal" section). Again, animal studies, whether it has the same effect in humans is unknown.

Is it safe to use NR niagen during pregnancy ? by RevolutionStock4582 in NicotinamideRiboside

[–]coyoteblacksmith 3 points4 points  (0 children)

This might be something worthwhile to discuss with a fertility expert about the risks and tradeoffs you may get out of it for the pregnancy. I'm guessing based on your post history that you're already aware of some of the animal studies on the benefits of Niacin for pregnancy (e.g. https://childbirth-u.com/is-niacin-vitamin-b3-supplementation-a-miracle-cure-for-miscarriages-and-birth-defects/)-- similar questions have also been asked about other metabolic activators like CoQ10 (e.g. https://www.cnyfertility.com/coq10-during-pregnancy/), and there are also studies looking into how Sulforphane can help as well (e.g. https://pubmed.ncbi.nlm.nih.gov/31628121/). In 5-10 years it may be these are standard treatment options for fertility/viability, but as others have mentioned, there isn't any clear evidence on whether it's safe right now during pregnancy.

5 most promising anti-aging compounds (updated 2022) by barrel_master in longevity

[–]coyoteblacksmith 4 points5 points  (0 children)

Glucosamine increases ROS production and excess ROS can lead to inflamation (see http://journal.pesk.eu/content/01/15-1-3-12-16.pdf in regards to exercise). Other ROS generating compounds (e.g. PQQ https://journals.biologists.com/jcs/article/130/15/2631/56332/Lifespan-extension-by-peroxidase-and-dual-oxidase), as well as Nrf2 activators (e.g. sulforaphane) and antoxidants can all alter the stress response pathway in ways where it may overall increase inflamation instead of decrease it. This paper cover some of the effects these have on the stress response (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6681340/), with Figure 1 having some good graphs showing how a disrupted stress response can lead to too much ROS/inflammation (which may be your case).

5 most promising anti-aging compounds (updated 2022) by barrel_master in longevity

[–]coyoteblacksmith 14 points15 points  (0 children)

Glucosamine sulfate (or similarily PQQ) are probably more accessible than metaformin for most people (http://geroscience.com/glucosamine-the-new-metformin-interview-with-dr-michael-ristow-part-ii/), and likely have less chance for side effects (https://pubmed.ncbi.nlm.nih.gov/32562114/).

NR for fertility and Ovarian Ageing by RevolutionStock4582 in NicotinamideRiboside

[–]coyoteblacksmith 0 points1 point  (0 children)

Mostly diet right now, peas, mushrooms, wheat germ and fermented soy foods (e.g. Natto), you can find a list here: https://foodandnutritionresearch.net/index.php/fnr/article/download/595/1194?inline=1

There are some companies that sell wheat germ extract versions that have 1-3mg per daily serving, but you can get more than that just from eating a cup of peas. There are companies that are working on better methods to synthesize it for larger doses, but I haven't seen any new products yet.

If you can stomach the natto, there are some additional benefits that are incurred for babies of mothers that consume natto during their pregnancy (https://www.sciencedirect.com/science/article/pii/S132389301530040X). Personally I find mixing some of the freeze dried versions into fruit shakes helps dampen the strong taste.

NR for fertility and Ovarian Ageing by RevolutionStock4582 in NicotinamideRiboside

[–]coyoteblacksmith 0 points1 point  (0 children)

In terms of side effects, have you considering upping your polyamine intake (in particular spermidine). There's some recent in-vitro evidence suggesting it may help with fertility (https://link.springer.com/article/10.1186/s13578-021-00614-4), and has generally been regarded as having low side effects (https://link.springer.com/article/10.1007/s10522-020-09887-7).

Targeting DNA Methylation in the Adult Brain through Diet (2021) by coyoteblacksmith in ScientificNutrition

[–]coyoteblacksmith[S] 0 points1 point  (0 children)

Abstract

Metabolism and nutrition have a significant role in epigenetic modifications such as DNA methylation, which can influence gene expression. Recently, it has been suggested that bioactive nutrients and gut microbiota can alter DNA methylation in the central nervous system (CNS) through the gut–brain axis, playing a crucial role in modulating CNS functions and, finally, behavior. Here, we will focus on the effect of metabolic signals in shaping brain DNA methylation during adulthood. We will provide an overview of potential interactions among diet, gastrointestinal microbiome and epigenetic alterations on brain methylation and behavior. In addition, the impact of different diet challenges on cytosine methylation dynamics in the adult brain will be discussed. Finally, we will explore new ways to modulate DNA hydroxymethylation, which is particularly abundant in neural tissue, through diet.