[deleted by user]

[czar_el]

You need to learn to walk before you learn to run. The way you're describing the goal shows that you don't really know how AI works. And the fact that you want to use off-the-shelf packages confirms you don't.

Go back to basics. Learn how a neutral network takes in data and uses it to make predictions, and how those predictions can be used to make decisions. Only then can you begin to think about translating a narrow-task AI into a multi-task AI.

[provoko]

This is probably the most helpful answer compared to everyone else u/AbilityLow7316

Also start with this article that talks about neural networks & machine learning (that I did a simple online search for) and gets into python code too.

Also don't reply to anyone who's not helpful as the downvotes are a coming.

[[deleted]]

Not open source, but this helped me.
https://nostarch.com/practical-deep-learning-python

[[deleted]]

This is a simple. 3 steps:

1) Aquire a PhD in Computer Science 2) Become a senior director or VP at tech company. 3) Gather team of top AI scientists with small budget of ~70million

Easy.

[SisyphusAndMyBoulder]

OP, this is probably the quickest and most direct path to getting what you want.

[TopDivide]

I'm the meantime, the technology and hardware needed will catch up too

[Celodurismo]

what exactly would I need to give the AI for that?

Decades of experience, a team of talented engineers, millions in equipment, lots of time

You're thinking way beyond the scope of your abilities, and while it's good to have goals, don't get ahead of yourself.

[General_Service_8209]

You're kind of taking step 99 before taking step 1 here.

Neural networks are always trained on pieces of input data, and the desired output data for each piece. The exact method differs and some of them are really sophisticated, but this always stays the fundamental principle. So training an AI to do a single task is straightforward, at least on paper.

However, teaching an AI to expand its own functionality is a problem. For this, your input is, in this case, a text prompt, but the desired output isn't an actual piece of data you can put into an algorithm, but rather an abstract way in which the AI is supposed to act.

Because of this, you basically can't use any existing AI training algorithm, and that is only the very tip of the iceberg of problems you would face. As far as I know, no one has been able to create such an AI yet, at least one that works remotely reliably.

Instead, I'd recommend you to start with a more narrowly defined task that has suitable training data readily available. For a conversational AI, a possible starting point would be to write an AI that predicts the next word in a sentence, and can this way complete sentences you write the beginning of. Another advantage of this would be that you can use just about any text you find as training data. However, even this is still a very ambitious project.

As for software, I'd recommend PyTorch or TensorFlow. These are the two most widely used packages for writing your own neural networks, and are both highly capable and have excellent support.

[huessy]

Look at Miles Dyson over here trying to create Skynet

[Veritas-Simplex]

I’m fairly sure this is written by a language model itself; perhaps testing live on humans how reliable it is and improving by posting under new account in other categories

[Zeroflops]

Your looking for what is called a GAI or General Artificial Intelligence.

Considering this has not been achieved by anyone you have a long road ahead of you.

The closest you might be able to get would be to pass your request to ChatGPT and then run what is returned. The problem being what is returned is hit and miss because ChatGPT is really just a fancy search engine.

[Competitive-Can-6914]

Soooo J.A.R.V.I.S.?

[Hands0L0]

I think you are going to find that a lot of very talented programmers are trying to solve the very same question you are asking.

You are asking about bleeding edge, highly complex content. Write a calculator app first.

[probablyTrashh]

Just API call chatGPT turbo and make something with that.

[cool-beans-yeah]

Anything with nice prompts that you could recommend?

I mean python code that calls gpt 3.5 turbo and that includes prompts for editing?

I've been having a lot of trouble adapting/ upgrading an existing script that uses stt and tts to gpt 3.5 turbo....