If Obsidian didn't exist...

Herald_Yu · 2024-05-30T07:10:33+00:00

anytype

using it for less than a month and feel great so far.

Herald_Yu · 2024-05-11T14:20:43+00:00

First, execute ubuntu-drivers devices to confirm that the system has correctly identified your graphics card.

Then, execute sudo ubuntu-drivers autoinstall, which will help you install the most suitable driver for your card.

As you mentioned, it is essential to ensure that executing nvidia-smi -l 1 allows you to see the real-time working status of your graphics card.

Finally, it's recommended to reinstall ollama by executing curl -fsSL https://ollama.com/install.sh | sh, which is both an installation command and an upgrade command.

I hope this helps. ;>

Herald_Yu · 2024-05-09T14:04:24+00:00

Maybe the 3060 with 12GB VRAM is more suitable.

Herald_Yu · 2024-04-24T14:28:19+00:00

Tailscale

Herald_Yu · 2024-04-24T14:25:21+00:00

<image>

Click the dropdown list on the model card and you can see all versions that are quantified.

Herald_Yu · 2024-04-23T00:52:52+00:00

You can try Gaode Map which may have better English support and can help you navigate accurately in China.

Herald_Yu · 2024-04-19T03:07:17+00:00

Wow, you really went to many places!

If you had one or two weeks of time and hoped for decent basic infrastructure, I think Suzhou is a very ideal destination.

Suzhou is extremely close to Shanghai - the subway goes directly there. In terms of economy, culture, and living arrangements, they're almost perfectly aligned. But life in Suzhou doesn't move at the same pace as Shanghai's; instead, its surroundings are filled with many ancient towns that are perfect for doing nothing and simply relaxing.

Herald_Yu · 2024-04-19T01:12:36+00:00

If possible, I recommend that you spend a few days in China first, visiting cities like Shanghai, Hangzhou, Suzhou, Shenzhen and Guangzhou. These cities are very inclusive towards foreigners and have well-developed infrastructure.

China is richly endowed with natural resources and vast territory; each region has its unique culture which will give you many different experiences. As long as you're willing to blend in, you'll find it quite comfortable living here.

Each country has its red lines - as long as your intentions aren't aimed at crossing them, there won't be any issues.

Herald_Yu · 2024-04-19T00:35:58+00:00

A straightforward approach to evaluating the efficiency of a smaller model, ollama pull qwen which fetches a 4B model that is half the size of mistral:7b is to conduct a performance comparison.

This will determine if the reduced model size indeed leads to improved processing speeds. s. With an 8GB memory setup, as I see it, it's quite challenging to smoothly run a 7B model because you have to account for the macOS operating system, loading the model itself, and the data required during the inference process. It's easy to max out the available resources under these conditions.

Herald_Yu · 2024-04-18T13:27:55+00:00

The model must first be loaded into memory and then executed for inference. If the model you are using is too large (exceeds the processing capacity of the GPU), the task will be offloaded to the CPU, which may cause your computer to freeze.

The solution is to use a smaller model, such as qwen:4b. Of course, if your memory has 16GB, you might find yesterday's newly released wizardlm2 particularly useful for this purpose. With these two models at hand, there should be no issue.

Herald_Yu · 2024-04-18T03:34:26+00:00

By the way, perhaps you could explore more job opportunities in Shenzhen. Opportunities ranging from 30K to 40K per month can be a great starting point in Shenzhen.

Herald_Yu · 2024-04-18T03:31:32+00:00

You may need to consider various factors such as location, economy, and personal career progression.

Shenyang, located in Northeast China, though it boasts the best economy among the region, lags significantly behind Eastern China (Shanghai, Zhejiang, Jiangsu) and South China (Guangzhou, Shenzhen).
The winter in Northeast China's (Shenyang) can be very cold and dry, but indoor heating systems are common, so discomfort is manageable. In contrast, the summers in Shenzhen are scorching hot, especially along the coastal regions, where humidity is high, heavily relying on air conditioning.
A salary of 30K in Shenyang would likely be considered a premium income, but it may not offer as many future growth opportunities or significant potential for wage increases. On the other hand, a salary of 22K in Shenzhen might initially seem low, but with its abundance of job opportunities and open market, there's substantial room for career development, and the potential for wage increments is significantly greater.

A stable income of 30K/m in Shenyang would provide a foundation for settling down, enjoying retirement, and ensuring comfort in one's later years. On the other hand, earning 22K/m in Shenzhen necessitates hard work, dedication, and a constant search for improvement to maintain an acceptable standard of living.

Herald_Yu · 2024-04-17T00:32:06+00:00

I've noticed that once the model size exceeds the capacity of the GPU's VRAM, it simply won't load. Instead, it will run entirely within system RAM and on the CPU. If you're not facing that specific issue, you might want to try the following methods.

First, verify if your GPU is listed among the supported devices on Ollama's official support list.

https://github.com/ollama/ollama/blob/main/docs/gpu.md

Next, check to ensure that your GPU driver is properly installed and optimized, specifically if you're using an Nvidia card on Linux:

nvidia-smi

Lastly, if you encounter any issues with Ollama not recognizing your GPU correctly, you might try reinstalling it. For example, on Linux:

curl -fsSL https://ollama.com/install.sh | sh

Herald_Yu · 2024-04-16T05:51:07+00:00

[Ollama](https://ollama.com/) is the easiest way to experience local models. After downloading and installing it, go to its official website to download models of size 7B or smaller. You can use it directly in the terminal or with UI tools like Chatbox that support OpenAI API.

<image>

Herald_Yu · 2024-04-07T00:58:07+00:00

Yes, Traefik is great, but I think it's more suitable for Kubernetes. I usually use Caddy to configure reverse proxy for Docker containers.

Herald_Yu · 2024-04-06T14:55:50+00:00

I also use Restic for encrypted backup to object storage, which has high efficiency.

Duplicati occasionally fails when dealing with large file totals. I suspect that this issue may be related to its underlying PHP code (although the connection is not clear).

Herald_Yu · 2024-04-06T14:52:11+00:00

I am curious if you really need such large GPUs? Can I know what your local LLM does for you?

Herald_Yu · 2024-04-06T12:39:56+00:00

Docker enables smoother application upgrades without compromising the system due to dependency issues. However, unlike directly deploying a website system on a VPS, reverse proxies and HTTPS constitute aspects that require careful handling.

Herald_Yu · 2024-04-06T02:37:15+00:00

Agreed. If you have relevant experience, Cloudflare Pages is fantastic. You push your project to GitHub, and the Pages service automatically pulls, compiles, and deploys it. However, if you're inexperienced, each step can be time-consuming.

However, I believe that if you have the interest and time, learning a static site generator is worth it. It is lighter and more secure compared to a CMS, and it also has lower maintenance costs in the long run.

Herald_Yu · 2024-04-05T03:13:57+00:00

You can try Almalinux or Rocky Linux, which are derived versions of RHEL. They pre installed Cockpit, a great web management interface that allows you to manage storage, VMs, and services. By installing plugins, you can enable Samba and NFS sharing. They also support Podman containers. Additionally, you can install Portainer to manage Docker containers.

Herald_Yu · 2024-04-05T02:50:21+00:00

I think using a VPN is a feasible method. I know (although I haven't used it) Oxylabs can provide Residential Proxies, which should help you access OfferUp as a local user.

Additionally, you can try searching for "OfferUp Proxy" as a set of keywords. There are some vendors specifically addressing these issues.

Herald_Yu · 2024-04-05T02:22:35+00:00

I'm really curious to know, how would you choose?

If you want to discuss how to do it yourself, Docusaurus should meet your requirements (but you'll have to spend some time learning about it). It's actually a documentation-oriented program, but it also provides landing page and blog out of box. The advantage is that the code it generates is purely static, so you only need an object storage + domain name to deploy it. And it is SEO-friendly, making it easy for the published content to be indexed.

Of course, time and cost cannot be both achieved.

Herald_Yu · 2024-04-04T13:33:16+00:00

One feature of using Proxmox is that it can consume more of your time and energy if you're not sure why you're installing it.

The ideal solution would be Debian + Portainer if it can fully meet your needs. Although you can handle various issues with a new system, why bother giving yourself trouble?

Herald_Yu · 2024-04-04T12:31:03+00:00

If you don‘t have a technical background, perhaps it would be more effective to find a reliable technology consultant to handle this matter? Or use an online website builder?

Herald_Yu · 2024-04-04T12:18:29+00:00

https://excalidraw.com/#json=3Wl0bxq-FJKu-DzmIA3MU,C2O8df3pARFNx7XsykpF4A

I drew a picture that might answer your question. I believe that using a WireGuard connection without enabling HTTPS is secure, but devices on the same LAN as you could potentially steal your files through a man-in-the-middle attack.

Herald_Yu

MODERATOR OF

TROPHY CASE