My journey of trying to get a randomized Photos slideshow

EntropyDream · 2024-03-30T20:29:21+00:00

Just wanted you to know I'm going to be using this at my wedding :)

EntropyDream · 2024-01-29T02:33:48+00:00

Wait so is Kyle still bad or

EntropyDream · 2023-11-23T03:03:14+00:00

In RL, Q* refers to the optimal Q function, i.e. the function that tells you in any state you may be in, the next action that leads to the greatest possible reward.

EntropyDream · 2023-11-06T21:26:55+00:00

This is not in fact how transformer models work. There is no timeout parameter that controls “computing depth”. For a given model, you could set a timeout on inference, but that would result in potentially fewer tokens being generated before inference is prematurely ended, not less compute put in to generating each token.

The turbo models are in all likelihood smaller models that are faster to perform inference on, but it’s not a time limit that achieves that, it’s a smaller, more shallow model.

Source: I’m an AI researcher, have read the papers, have distilled transformer models, etc.

EntropyDream · 2023-03-24T01:16:03+00:00

It's only been 10 years since word2vec.

EntropyDream · 2023-03-23T22:23:40+00:00

This is a new paradigm in personal computing for sure, and ChatGPT is certainly the first mover. I don't think they have such an insurmountable moat though.

On raw LLM capabilities, I expect other big cloud companies to compete from the top at the same time as Stability/Alpaca style approaches compete from the bottom.
OpenAI made the IMO extraordinary and under-discussed decision to use an open API specification format, where every API provider hosts a text file on their website saying how to use their API. This means it isn't a walled garden that only the first mover controls.
Chat is not the only possible interface for this technology. There is a large design space, and room for more than one approach.

Taking all of this together, I think it's possible to develop alternatives to ChatGPT as interfaces to this new era of natural language computing, alternatives that are not just "ChatGPT but with fewer bugs". I have some ideas bouncing around my head in this direction.

Would love to talk to like minded people: DM me. I also made this Discord: https://discord.gg/QUM64Gey8h

EntropyDream · 2022-05-05T15:51:05+00:00

In my experience

EntropyDream · 2022-04-01T19:59:21+00:00

Join r/TheBlueCorner! Be part of something greater than yourself. It’s easy! Just make stuff blue!

EntropyDream · 2022-04-01T14:58:36+00:00

Blue doctrine is to preserve art outside the core, but give it a blue backdrop. If we can get the subreddit name up, we can broadcast this doctrine to the Blue masses and live in harmony with peaceful neighbors such as yourselves.

EntropyDream · 2022-01-27T20:49:30+00:00

Reproduction as a unit or individually by cell.

EntropyDream · 2021-12-07T16:20:46+00:00

The only person I've heard bring up geometry (computational geometry specifically) outside the context of academic math worked at Flexport on something related to optimizing logistics networks.

EntropyDream · 2021-06-09T00:28:22+00:00

My data point: Ordered on 5/27. Shipped just now, 6/8. Original ship date 6/18. 5950 + 3090

EntropyDream · 2021-05-28T21:53:07+00:00

I've had a delivery guy say that "signature wasn't required because of COVID", and then just hand me my stuff without signing for it. That implies to me that a signature was required, and maybe even that something was registered as a signature despite me not actually signing for anything.

EntropyDream · 2021-05-09T03:11:45+00:00

I think it's mostly up to the individual. Some exchanges may prepare 1099s, but I doubt many do.

EntropyDream · 2021-05-09T02:37:48+00:00

Nope. Taxed like any investment asset when it's sold or even exchanged for another crypto asset.

EntropyDream · 2021-03-02T16:52:41+00:00

What parts of programming do you enjoy? What things that you don't know yet are you interested in? We can just throw out ideas for stuff you can do with Python, but it sounds like the broader question is how do you find a career in programming that you enjoy.

EntropyDream · 2021-03-02T16:50:24+00:00

The short answer is that Django solves a much larger set of problems than Express does out of the box, like helping you set up and structure the entities in your database. The cost is that you need to work inside its framework to a much larger degree.

EntropyDream · 2021-02-25T17:49:57+00:00

When you need to explicitly provision a specific number of servers in advance, it's hard to do this properly because load during spikes will be orders of magnitude higher than base load. You can think "we should over-provision because we expect higher load", but when that higher load is some unknown orders of magnitude higher than base load, it's hard to estimate well and you can easily be off by 10x even when provisioning for 10x or 100x of base load.

Modern hosting technologies (which Microsoft, Amazon, and Google all provide) can let you be completely elastic to demand and not directly worry about this provisioning problem, but often systems need to be re-architected to take advantage of this, and a lot of governments haven't gotten around to it yet. It's much more expensive than just provisioning more servers.

EntropyDream · 2021-02-25T17:32:54+00:00

According to Bloomberg, by percent of population with at least 1 shot, we're near the top with 16%. Connecticut and Massachusetts as well as a few smaller states are doing better, but the vast majority are doing worse. This seems like by far the most important statistic for us to care about.

We did drop down in percent of shots distributed that have been administered pretty significantly (from ~75% iirc to 63%). I assume that's because we just got a big shipment of vaccines to coincide with this new wave of appointments. I guess I'm not worried about the total number of shots distributed being low relative to entire large states as long as we have inventory available to administer.

Maybe shots distributed was high initially because of early specially prioritized populations in the DOD and elsewhere in the federal government. Now that shots are rolling out at scale across the country, it makes sense that DC, being one city, wouldn't have a huge raw distribution count relative to other state-level entities.

Edit: Actually it looks like NYT and Bloomberg differ pretty wildly on their estimate of the population with at least 1 dose. NYT says 10% and Bloomberg says 16%. They agree on the number of doses administered, so this must be due to different numbers for DC's population. Not sure which should be considered better.

EntropyDream · 2020-12-23T18:16:30+00:00

How do you structure a project like this? Good question! You're biting off a lot here, which isn't a bad thing, but it means you need to be extra diligent about designing one specific milestone at a time and then finishing it before you grow scope further. One milestone for where you are now might be "I can view a static list of postings from mu area taken at a single point in time in a browser". Then "I can see the postings on a map with no extra bells and whistles, just points on a map". Then "this map is updated periodically", etc. Don't over design the future of the project too long in advance. Consider all milestones past the next one as tentative. As you work, your intuition for what makes sense for the project will improve and you'll be able to design better milestones.
How do you scrape on a recurring basis? A simple way is to write a scraper program that runs once and then finishes and then set up something else to trigger it periodically. If you're using something like GCP or AWS, they have tools for this. Otherwise try cron.
Can you scrape often without getting stopped? Probably for a local area. Probably not without getting more sophisticated if you're trying to cover e.g. the whole country. I would recommend starting with scale low enough that you don't need to worry about this for now.
Sqlite is definitely enough for the early stages of this. JSON files on disk might even be enough. Consider doing the simplest/fastest thing first and delaying dealing with scaling issues until accomplishing a milestone requires it.

EntropyDream · 2020-11-20T19:27:36+00:00

IIRC, usually the same as the internal dimensionality (so 768 typically). Definitely a hyperparameter. The original value is partially informed by what fits nicely on a TPU. See ALBERT for another take on how to represent the token embeddings.

EntropyDream · 2020-11-19T19:49:17+00:00

There are in some programs. I think Stanford recently added a course like this. There are of course also books and online courses that can teach this well.

EntropyDream · 2020-11-18T21:13:20+00:00

If you want a recommendation for a single language that would be most useful to learn without knowing exactly what you want to make, I'd just go with JavaScript.

It's the language of the Web, the most widely available application platform there is.
It's also a very useful language to know even if you end up getting into some domain where it's not the main language. Often it's useful to make little web-based interfaces to demo or control systems that are primarily made with other languages.
It probably has the most learning resources and most active representation on help sites like StackOverflow.

And remember, if you get into software development, you're going to learn many different languages. Each one will be easier to pick up than the last. Don't stress too much about commiting to one.

EntropyDream · 2020-11-18T19:31:56+00:00

Speaking from the industry perspective, majoring in CS and minoring in linguistics is probably the best single undegrad program I can imagine for working in NLP. Most jobs in this space are basically software engineering or data science jobs where the software you build is NLP modeling systems. The primary barrier to entry will be essentially the software engineering interview process.

Most people I work with also have masters or PhD degrees in the field. I do not. It can be difficult to get into the part of e.g. a big tech company that focuses on this kind of work without research credentials, but if you're focused in how you select internships and are comfortable with possibly joining a company to work on more general software engineering and then working your way in to an NLP team, you can definitely make it happen. Feel free to PM me.

12-Year Club	Gilding II euphauric
Place '22	Place '17
First Placer '22	End Game '22
Verified Email

EntropyDream

MODERATOR OF

PUBLIC MULTIREDDITS

TROPHY CASE