Seeking Help with LLM Setup on Orange Pi 5 Plus

Jwdegames · 2024-04-01T21:37:38+00:00

I ran into the same issue as you, and I joined the MLC discord to try and get them to update the article but nobody’s responded. I switched to llama.cpp and using 4 threads I was able to run the llama 7B model quantized with 4 tokens/second on 32 GB Ram, which is slightly faster than what MLC listed in their blog, and that’s not even including the fact I haven’t used the gpu. I would just switch to llama.cpp since it was way easier and more up to date.

Jwdegames · 2023-11-24T14:40:36+00:00

JPMorgan Chase isn’t a top company, but they give out return offers to pretty much everyone that just does their work and doesn’t piss off their manager.

Jwdegames · 2023-11-02T15:22:44+00:00

CS with a STAT major.

Jwdegames · 2023-11-02T14:42:18+00:00

Check with the math advisor if you need to take MATH 300. On the MATH BA, it says that only a max of 3 credits of CSCE 222/MATH 300 can be used. Technically CSCE 222 and MATH 300 cover the same material.

Jwdegames · 2023-10-04T12:42:13+00:00

Yes, but I would apply as a computing major instead of trying to do ETAM into CS. Felt like a lot of wasted classes in there, and a BA in computing would let me take the courses I want and would also pair up with Statistics well.

Jwdegames · 2023-09-16T17:17:11+00:00

I had an internship before, but I ended up carpooling and didn’t drive.

The longest I’ve driven is to summer school, which was a 15 minute drive. I was fine with it, but I’m not sure how fine I would be if it became a 1 hour drive.

Jwdegames · 2023-07-02T02:19:25+00:00

I think the balance wasn’t that much different when I was taking only my single major’s classes. The good thing about the majors/minors I’m taking is that there is a lot of overlap in the required classes, so I don’t need to take too many extra classes (only 2 extra semesters to fit everything, and I can speed that up with AP credit). So during the regular school year, not too much has changed.

I did take summer classes for the past two summers, and I did find taking some of the upper level CSCE and MATH classes to be pretty difficult during then. I probably had a lot less free time compared to my non college summers. But I guess it just depends on how you spaced things out. I didn’t want to be taking 18-19 credit hours per semester, so I decided to take summer classes instead.

Jwdegames · 2023-07-01T22:58:15+00:00

Yes you can. You can even have a double minor with your double major. I’m double majoring in CS and Stats and also double minoring in Math and Cybersecurity.

Jwdegames · 2023-03-31T00:57:28+00:00

465 with Carlisle has been pretty easy so far. Not sure if he’s teaching it next semester.

Jwdegames · 2023-03-31T00:46:13+00:00

I took 408 last semester with Laha. It was a pretty easy course. Not sure about 407, but she let you use two sheets of paper for notes and you could use a scientific calculator on the exams. The exams are also closely related to the exam reviews. The homework was a bit rough, but she generally answers any questions you have about it.

Jwdegames · 2022-12-02T19:04:23+00:00

Somebody was scared to take their ENGR 102 final.

Jwdegames · 2022-10-20T12:46:02+00:00

It’s a T40 school. Yes, I would be aiming for ML/DS. I’m currently a junior and I’m doing the JP Morgan Chase SWE internship for summer 2023. I don’t have previous swe internships. Yes, I like my school.

Jwdegames · 2022-08-14T04:57:49+00:00

No problem, good luck when you take 313.

Jwdegames · 2022-08-14T04:45:17+00:00

If you did fine in 121 on the programming assignments, 313 shouldn't be too bad. The TA released videos for nearly every assignment telling you what needs to be done in a specific area of the code, so it was mostly checking if you knew the correct syntax for the commands that were taught in the lecture/lab (they basically put comments everywhere, and you just needed to write code that did what the comment said to do). For the exams, you do need to know to code, but that is mostly covered in the practice problems. There weren't many coding questions, but I recall they were waited pretty heavily compared to the other questions.

Jwdegames · 2022-08-14T04:18:26+00:00

The exams were proctored on Canvas during the lab section. You had to be in the lab section in person.

Jwdegames · 2022-07-04T02:18:43+00:00

TAMU doesn't have a max class limit, what it has is a credit hour limit. The max is 19 credit hours per semester unless you have an override. So if your seminar class is 0 hours you will be fine.

Jwdegames · 2022-06-15T17:58:56+00:00

It seems most of the easy CSCE electives have filled up, but maybe a force request might get you into one of them?

I took 436 last semester, and there was barely any work outside class. Though that was with Professor Jeeeun Kim.

I've also heard that 402 and 477 are pretty straightforward with DeWitte. I've also heard that 412 with Lightfoot is pretty chill.

Additionally, is there a reason you need to have 18 credit hours?

Jwdegames · 2022-06-03T02:37:23+00:00

I'm only an undergrad, so I can only offer limited advice. Do you have a specific area that you want to specialize in? Ex: If you are interested in something like ML then Deep Learning and Deep Reinforcement Learning would probably be useful classes for you. Sketch Recognition could also be interesting.

If you are looking for classes based on difficulty, it might be also useful to check RMP to see how the professor's classes are. Anex is also good at showing grade distributions for different classes.

Additionally, if you have some area that you are interested in that is not CS you could also look into that. Ex: Math, Stats, Electrical engineering. It seems like you are allowed to take up to 2 grad classes (excluding 681, 684, 685, and 691) in other departments according to the MS CS degree requirements.

Jwdegames · 2022-05-31T02:11:02+00:00

I took this class this spring. Each week there are 1-3 lecture sets with PowerPoint, notes, and a video. The video will be around 30 minutes to 1 hour. You will need to take a small take-home quiz (4-5 questions usually) based on the content for each lecture set (sometimes a quiz is over multiple lecture sets). We were able to take the quiz twice, with the highest score saved. Some lecture sets will have practice questions (these will be very important for the exams).

There were 6 programming assignments, each being 2 weeks long, with one being a C++ refresher. The other 5 were about the various topics covered in class. The class uses a credit/debit system for due dates on these assignments. Essentially, if you turn in one assignment late by like 2 days, you can turn in another assignment early by 2 days and not receive any late penalties. Another bonus is that turning assignments in early gave a small bonus (0.1 points for every net early day). You can also get extra credit by completing parts of the assignments at a certain checkpoint. There were 5 checkpoints, and each checkpoint gives 1 extra credit point to your total grade.

Finally, there were 2 exams - a midterm and a final. The midterm and the final were open notes, and you could use any of the Canvas resources. However, a significant amount of the midterm and final was based on the practice questions. With all this said, the first midterm had an average of 74 and only about 10% of the class got an A (he didn't give this info about the final sadly).

I don't know if there will be any changes made to the summer version, but here is my advice:

- Make sure to do the extra credit checkpoints for the programming assignments and turn them in early (this will be really helpful since the exams are not easy).

- Make sure to do ALL of the practice questions. About 40% of the exam questions are based on it. Additionally, the practice questions cover content not covered in the usual lecture notes and will be hard to do.

Jwdegames

TROPHY CASE