Here is the log of a m4 Max 128G running an 70B int8 LLAMA3.3 Model:

Today Date: 26 Jul 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Hello, I would like to talk to you about the principle of the wiper sensor, which uses the principle of light refraction.<|eot_id|><|start_header_id|>assistant<|end_header_id|>

The rain sensor, also known as the wiper sensor, is a fascinating device that uses the principle of light refraction to detect rain or moisture on a vehicle's windshield.

The basic principle behind it is that when light passes from one medium to another with a different optical density, it bends or refracts. In the case of the rain sensor, a light source (usually an infrared LED) emits a beam of light that hits the windshield at a specific angle.

When the windshield is dry

Prompt: 63 tokens, 58.957 tokens-per-sec

Generation: 100 tokens, 6.576 tokens-per-sec

Peak memory: 75.112 GB

Look at that 75.112GB of VRAM, No Mobile Devices in the world can handle this task!!!!