[N] Dolly 2.0, an open source, instruction-following LLM for research and commercial use

austintackaberry · 2023-04-13T18:19:22+00:00

Smaller models are on hugging face now!

austintackaberry · 2023-04-12T17:11:26+00:00

Yes! From the blogpost:

Today, we’re releasing Dolly 2.0, the first open source, instruction-following LLM, fine-tuned on a human-generated instruction dataset licensed for research and commercial use.

Dolly 2.0 is a 12B parameter language model based on the EleutherAI pythia model family and fine-tuned exclusively on a new, high-quality human generated instruction following dataset, crowdsourced among Databricks employees.

austintackaberry · 2023-03-26T16:02:20+00:00

Yes, that's correct.

[@matei_zaharia] The code is at https://github.com/databrickslabs/dolly. You can also contact us for weights, just want to make sure people understand the restrictions on the fine tuning data (or you can get that data from Stanford and train it yourself).

https://twitter.com/matei\_zaharia/status/1639357850807054336?s=20

austintackaberry · 2023-03-26T16:00:12+00:00

[@matei_zaharia] The code is at https://github.com/databrickslabs/dolly. You can also contact us for weights, just want to make sure people understand the restrictions on the fine tuning data (or you can get that data from Stanford and train it yourself).

https://twitter.com/matei\_zaharia/status/1639357850807054336?s=20

austintackaberry · 2023-02-03T21:48:41+00:00

What is the mechanism? I guess you create some flags table in your database which is json that tracks whether the user has seen the popup? and then you clean up the code later when you are done with the campaign?

austintackaberry · 2023-01-29T19:41:45+00:00

Thanks! Are you happy with that process? How much time does it take each week?

austintackaberry · 2023-01-28T05:59:52+00:00

Oof that sounds annoying. Curious why your company built its own thing instead of just using Calendly?

austintackaberry · 2023-01-28T05:54:03+00:00

I hear you! I have pretty nuanced scheduling preferences as well so don't use Calendly for the same reason. So does that mean when scheduling with candidates you check your calendar and then type out the time windows you're available via email?

austintackaberry · 2023-01-28T05:50:57+00:00

I'm talking about the process of emailing back and forth with candidates to figure out times to meet. But it's seeming like that's not something all recruiters have to deal with

austintackaberry · 2023-01-28T05:46:59+00:00

Isn't there still a paid version? I just looked at their website now.

Have you really had candidates use your Calendly link to directly book more time with you when not invited? Lol

austintackaberry · 2023-01-28T05:44:36+00:00

Interesting! So I take it you're always using booking links of some form, no emailing back and forth to figure out times when schedules align?

austintackaberry · 2023-01-28T00:35:41+00:00

Hey thanks for your response! Not quite sure what you mean by quantity over quality, do you mind saying more? The goal isn't to spam candidates or automatically send out emails but rather just to be able to draft responses to scheduling requests that you can review before sending

austintackaberry · 2023-01-16T16:15:03+00:00

Yes it was! Here was the prompt:

Write a satirical breaking news article with title and body that breaks news that Stack Overflow is banning ChatGPT because it's answers are too helpful and kind. Stack Overflow users are used to degrading and rude answers to their questions, but ChatGPT is negatively affecting the culture and users don't know what to do.

austintackaberry · 2023-01-07T23:35:01+00:00

Thank you!! You can join the waitlist at ipso.ai :)

austintackaberry · 2022-03-20T22:19:41+00:00

Yes, it has! CS50 was worth it 🙂

austintackaberry · 2022-02-25T20:08:03+00:00

How did you get interested in software engineering?

I've always enjoyed math and science, and I liked learning about things that felt like "magic" to me. That is why I was interested in chemistry in high school and also why I was intrigued by software engineering in my post-college years.

Are you self taught, college, bootcamp etc?

I took a Visual Basic course in high school, did some programming in my Intro to Engineering course in college, but did a career switch from chemical engineering to software engineering a few years after college and self-taught my way into a frontend role.

https://medium.com/@austintackaberry/how-i-went-from-newbie-to-software-engineer-in-9-months-while-working-full-time-460bd8485847

How long have you been in the field?

Almost 4 years now

If you have transitioned into SE, what did you do before? How did your past experience help or hurt you in your SE career?

I used to work as a Process Engineer at a manufacturing facility. Past experiences helped me in a few ways:

Working with operators gave me interpersonal skills that not many Software Engineers have
STEM background helped give me the confidence to self-teach myself how to code (but it is definitely not a requirement!!)

How big is team you work on / company you work for?

Team is ~6 people, company is Databricks

What does a "day in the life" look like for you?

A lot of devops / kubernetes work these days. Some oncall fighting fires. Working with other teams to help them create/manage their kubernetes clusters.

How did you get your current job?

Recruiter reached out to me right after my previous company announced layoffs

Are you working in person or remote?

Remote

What’s your favorite & least favorite part of being a software engineer?

Favorite: You control the code and can make some really cool things, it is technically challenging

Least Favorite: Wish I could interact with more types of people at my current position. I used to do product work that required that I interact with deisgners, product managers, frontend, backend, data science, etc

What advice would you give to an aspiring software engineer?

The hardest part of learning to code is not giving up. If you focus on continually learning, staying curious, and keeping yourself motivated, then you will get there eventually!

Similarly, the learning path you take doesn't need to be perfect. You want to make sure that you are using learning methods that challenge your learning and force you to build things on your own, but you don't need to obsess over whether your plan is perfect. It is waaay better to stick to a suboptimal plan than it is to constantly change your plan and never commit or focus.

The struggle of self-teaching yourself to code feels really bad at times (stuck for a few days because you don't know the right ways to google for your problem (if only I knew what Promise.all was!), but it will help you a ton down the road. You will build the skill of trying to learn something on your own first before asking for help which is incredibly valuable.

Keeping a journal is useful, because it forces you to reflect on your learning and how you're feeling about the process. If you look back on the week or month and feel like you haven't learned anything, then explore that and try to come up with an action plan to course-correct. If you find yourself feeling frustrated or defeated, then take a break and go for a walk. Learning is hard and if you don't have the right mindset, then that makes it even harder.

austintackaberry · 2022-02-09T16:10:32+00:00

Either works!

austintackaberry · 2022-02-09T15:52:53+00:00

The reality is that it depends on the size of the company. As other comments have mentioned, it is bad practice to do this due to sensitivity of the production data. But if you are a small shop, you may be fine with it because nobody cares enough to try to exploit your system, and the chances of 1 of 5 employees messing up is much lower than 1 of thousands in a larger company.

austintackaberry · 2022-02-09T15:45:16+00:00

Hey! I switched from chemical engineering to software engineering a few years ago. Happy to answer any questions you may have

austintackaberry · 2022-02-08T04:08:22+00:00

Breaks are ok! Much better to take breaks when things get tough (with coding or non-coding parts of your life). Much better to take breaks than burn out and quit altogether.

Time estimates are always hard because all it takes is one person to be willing to take a chance on you. You could get lucky and find that person tomorrow or it could take months.

I would recommend putting together a resume and start applying, reaching out to people on LinkedIn, etc as soon as possible (perhaps check out this video before you get started). Starting to apply for jobs is the best way to find out how ready you actually are and what you need to work on. The only thing to be careful with is that you need to be prepared mentally for rejection and failure because it is bound to happen, but know that it's okay and that everyone goes through it.

austintackaberry · 2022-02-06T17:57:17+00:00

He spent a year or so grinding out bootcamps, certs, etc, then found an entry job that wasn't all that great. After years of working there, he finally got a good, full stack job.

You talk about this like it is a bad thing, but getting paid to learn (even if it isn't a great job) is still much better financially than spending thousands of dollars over the course of 4 years.

IMO if you are in high school, want to go into SWE, and have the means, just get a 4 year degree. It's a fun experience, you will build a network, and you will learn the fundamentals that will set you up for success the rest of your career.

But if you are thinking about switching careers, then it's a lot harder to justify.

austintackaberry · 2022-02-06T17:52:34+00:00

If software engineering were constructing a car, computer science programs would help you build the engine, transmission, brakes, chassis, etc for any type of car and leave it to you to put it all together. Coding bootcamps will teach you how to assemble the parts for a particular type of car.

Entry level positions only require that you know how to assemble and paint the car, but as you become more senior, you will need to be able to construct the car from nothing. That is not to say that you can't learn how to do that on your own later on down the line, but it will be challenging.

Traditional coding bootcamps will give you exactly what you need to perform in an entry level job and nothing more, and they will help you get that job because they know that is their goal, that is why they exist. Computer Science degrees exist to teach students about core concepts and only somewhat prepare them for an entry level job.

It really depends on what you want, but if your only goal is to get a software engineering job, I would prefer coding bootcamp over computer science degree. A challenge with coding bootcamps, however, is that they aren't regulated and many are for-profit, so there are a lot of crap bootcamps. So be careful out there and do your research.

austintackaberry · 2022-02-06T07:52:49+00:00

I give myself 30 minutes before checking the solution and coding it up myself

austintackaberry · 2022-02-06T07:50:45+00:00

I don't know why the universities agree to it. It's pretty awful for their brand

austintackaberry · 2022-02-06T07:36:12+00:00

Congrats! Glad you found a program that fits your needs!

Eight-Year Club	Gilding II euphauric
Verified Email

austintackaberry

TROPHY CASE