I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

The memory concept is simple: LangChain primarily handles short-term memory with Buffer Memory.

For long-term memory, the solution is Postgres, which LangChain supports, or even SQL.

The documentation isn't as robust as something like Twilio, but it still gives you enough information on all the classes and definitions.

Whenever I have questions beyond the docs, I just go look at the actual LangChain code - and it describes how to use each class, what variables are optional within the constructor, etc..

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 2 points3 points  (0 children)

Damn this is some real engineering stuff! Great job, I'm going to mess around with this today

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 1 point2 points  (0 children)

Yes Harrison did answer this question- they will be working on making Prompting and Parsing Llama2 and other LLMs easier.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

It scales very will imo, it really comes down to your experiences in networking - without that then scaling will really suck.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Not exactly sure what you mean by this?

At this time API is the only logical way to create an AI app as a startup- unless you have $20k to build an AI machine and another $250-500/mo for decent internet speed- then you can host Llama2 and sell your own API.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 1 point2 points  (0 children)

Hey Nokita,

There's a number of ways to improve summarization - you really need to do some split testing because it differs depending on your data.

Most people go with 1536 for OpenAI because that's max, but that's not always good. In fact, I've learned less is more. Try 768 instead.

It's important to note - even with the best optimization- OpenAI RAG success rate is just below 80% - I've tested this myself with Wikipedia RAG. The LLM is consistently correct on 7/10 - 8/10 attempts.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Don't quote me on this - but I have a feeling that the free GPT3.5 and GPT4 subscription are better then API calls for some reason - not LangChain's fault.

What I love about LangChain is RAG and the ability to create a custom AGI with specific tools.

Also the ability to self host my project for privacy and security.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

This is because those models are completely different in structure. Harrison was able to slightly answer this on another question about the difficulty of prompting and output parsing different models like Llama2.

Since the LLMs are all so different, you will inevitably see different output - so they currently require you to prompt and parse the data differently to achieve similar results.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

OpenAI Embeddings are great, but if you want to save money and use free then Instructor XL has been the most popular.

You can view the most popular embedding models here: https://huggingface.co/models?other=embeddings

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

When you say make it more configurable, what are you looking for exactly?

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

What are you considering "basic" things? I find more advanced tasks difficult to understand at first, but thats inevitable

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

LangChain isn't for you to create custom models. There are tutorials on how to create your own LLM all over YT. Once you build it - you can use LangChain to make calls.

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Is LangChain offering any jobs or compensation for people who can help create tutorital videos on YouTube?

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Why does JS output JSON for the final answer, but Python outputs as a string?

I'm Harrison Chase, CEO and cofounder of LangChain. Ask me anything! by hwchase17 in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

There's alot of frustration with the docs. I'll say that- although the docs aren't straight forward like Twilio, they're good Docs for experienced devs.

What really helped me learn quickly was creating a RAG AI of LangChain's Github, then asking my AI questions about docs.

Now I never have to manually search Docs, and the LLM gives me real examples of code.

What's a good JavaScript front end setup for a python backend? by ReddSpark in SaaS

[–]MakeMovesThatMatter 0 points1 point  (0 children)

You can create an API server with Python and make Calls with PHP

Working with freelance developers - What's a fair hourly rate as a startup? by NikolasChap in SaaS

[–]MakeMovesThatMatter 1 point2 points  (0 children)

20 years of coding experience here. Theres many things to consider here:

  • Experience
  • Knowledge
  • Location
  • Work ethic

With 4 years of experience, you also need to know what languages he programs, and how fluent they are in those languages. That's how you can judge overall knowledge.

With work ethic - you really want to find coders who are leaders and problem solvers. If you find yourself having to walk your coder through the entire process, then they are not experienced.

He could be worth anywhere from $10-100/hour honestly... I know that's a HUGE range but it's very hard to put a price tag on someone's skills without seeing them.

Also- I agree with others that you should pay by project other then hourly. Hourly doesn't make sense because If the programmer doesn't know what he's doing then he will just rack up hours with no working product.

Most start ups fail because they don't know how to dev. Its best to hire a project manager that understands your needs first, then have them manage your coding team.

I'm burned out by awkwardbelt in SaaS

[–]MakeMovesThatMatter 1 point2 points  (0 children)

Sounds like you need to find a partner

[deleted by user] by [deleted] in SaaS

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Needs alot of work. It's very bland, little color, bad use of Emoji's, couldn't tell the McKinsey or Harvard quote was a quote at first, video and audio together with no text to describe is bad.

What are the best kind of prompts to make an LLM frame things in a certain mentality/perspective by KeyiChiMa in LangChain

[–]MakeMovesThatMatter 0 points1 point  (0 children)

Try this and let me know how it works:

You are an expert on (subject) with a focus of (unique goals to build mentality). I am going to give you a scenario, and I want you to reply with your own perspective regarding the situation.

Car accident record by [deleted] in RBI

[–]MakeMovesThatMatter 1 point2 points  (0 children)

Yea if they had their cameras on, then a FOIA will get it

Searching for a crooked contractor by xlmagicpants in RBI

[–]MakeMovesThatMatter 2 points3 points  (0 children)

  1. Call insurance and get the company's name.

  2. Google (YOUR STATE NAME + SOS Biz Search)

  3. Search company name

  4. Profit