Algorithm system

Looking for partners4Lin Yuan and Zhang Yan were both slurping noodles together.

“Senior Brother, have you ever considered becoming a recluse?” Zhang Yan suddenly blurted out, seemingly out of nowhere.

“Huh?” Lin Yuan was stunned for a moment. “Becoming a recluse? That doesn’t sound like your crazy personality. I’m only 25 now; am I supposed to retire early?”

“Look at the situation now.” Zhang Yan held her bowl and gestured around with her mouth. “We don’t even dare to open the curtains. We have to be careful when sleeping at night, afraid of making any noise, and there are colleagues on guard upstairs and downstairs.

What kind of life is this?

I can already imagine our future life, with people following us wherever we go.”

Lin Yuan put down his bowl and chopsticks. “I didn’t expect it to be like this either. I just simply wanted to do something good; I impulsively open-sourced the code. To be honest, I regret it now. The happiest I was was when I earned my first million.

At that time, I felt like I had money, and there were no burdens that fame and fortune bring.

Thinking about it now, being content with a little wealth is quite good.

But if I really were like that, you probably wouldn’t think much of me.”

Zhang Yan thought for a moment. “That’s true. I hope the person I follow is extraordinary, but I’ve only just realized that being extraordinary comes with a price.

However,” Zhang Yan’s eyes suddenly gleamed as she looked at Lin Yuan, “since we’re here, let’s make the best of it. We’ll brave through mountains of daggers and seas of fire together.”

“You’re right. I’ll go see if the download is finished. I found a good small AI company. We can’t rely on the big companies, so I want to try to give these small companies a push.”

“You go ahead and work. Leave the dishes; I’ll clean up.”

“Next time, let’s just order takeout. Washing dishes and chopsticks is too much trouble.”

“It’s not troublesome. It’s quite good like this now. My dad said it’s a good way to temper my character.” In fact, since birth, Zhang Yan had never done housework so intensively.

Lin Yuan returned to his room. Even with the help of gigabit fiber, the DS-LLM Universal Large Language Model was still downloading.

【Speed: 98ss: 67.2%】

Under the black command-line window, the cursor flickered. Lin Yuan saw that it wouldn’t finish downloading in a few minutes, so he simply ran out to help Zhang Yan with the housework.

“Oh? Finally remembered me? And you even came to help me. A soft and sweet wife is better, right?” Zhang Yan said happily.

“Um… mainly because the entire model file is too large; it hasn’t finished downloading yet.”

“You jerk.” Zhang Yan was enraged. “Your computer’s mistress is busy, so you come to tease me? You sure know how to save time.”

Lin Yuan just smiled and went to wash the dishes.

Whenever he was busy with work, Zhang Yan handled these chores. Seeing a young lady like Zhang Yan roll up her sleeves to wash dishes, Lin Yuan still felt a little bad. Therefore, he would help whenever he had free time.

After their playful banter ended, the kitchen counter was splattered everywhere with white dish soap foam.

“Look at you, you’re just making more work.” Zhang Yan complained while wiping away the splashing foam. Of course, deep down, she was secretly delighted.

“You go and work. I appreciate the thought. Oh, right, what do you want for dinner tonight? Don’t say ‘whatever’.”

“Eat you!” Lin Yuan suddenly blurted out, seemingly out of nowhere. He hated thinking about what to eat for the next meal the most. Anyway, what they ate now was all specially supplied meat, vegetables, eggs, and milk, emphasizing original flavor, green, and pollution-free. Everything tasted good.

“Still eating me?” Zhang Yan pouted. “How long has it been since you ‘ate’ me?”

“Uh…” Lin Yuan suddenly remembered that his recent essence had been fed to the computing power system, and he had indeed neglected Zhang Yan. “I’ve been busy recently, haven’t I? I’m off now.”

“Take it easy!” Zhang Yan’s voice came from behind him. “I still want to live a long life with you.”

Zhang Yan clearly mistook Lin Yuan’s lack of vigor as a sign of physical exhaustion.

Lin Yuan returned to his room again, and this time, the download was finally complete.

272GB!!!

The DS-LLM 67B model weight files, source code, various toolchains, and documentation, all added up to a massive 272GB.

Lin Yuan looked at that terrifying model weight file, which needed to be loaded into the GPU. The size of this thing actually reached 268GB. Even if the file size could be reduced by lowering precision, the smallest it could be was 126GB.

“Alright! AI is really a money pit.”

Even though DS-LLM claimed to be much smaller than OpenAI’s ChatGPT-4 model weight file, as the latter’s similar files are measured in TBs, it still reached the hundred GB level.

The model weight file is the most important part of an AI model.

You throw money to buy a bunch of GPUs, then burn through a lot of electricity, and what you finally train is this thing.

All the mysteries of an AI model’s understanding of language and its responses are contained within the model weight file.

But do you think that with the file, you can understand the AI’s reasoning process? No way.

Take ChatGPT-4, for example; its parameter scale has already reached the trillion level. The DS-LLM in front of Lin Yuan also has 67 billion parameters.

Do you want to figure out the specific role of a certain parameter in the AI model’s reasoning process? Save your breath; it’s completely impossible.

If you reverse-engineer an AI model’s reasoning process, you’ll only see vectors. Humans can only understand a very small part of the correlation process. For most of the AI’s reasoning process, the human brain can no longer keep up.

AI has become, in fact, something that works according to human deployment. Humans provide the ideas, and AI completes the work. As for the specific process, it’s a black box, a completely invisible black box.

Lin Yuan was shocked by the parameter scale of the large AI model.

He suddenly realized, shouldn’t this be a matter of course? Why should I be surprised?

He suddenly thought: Why should I be surprised?

The parameters of the most advanced large AI models have long reached the trillion level. Shouldn’t he have been mentally prepared for the size of the model weight file?

‘So, why did I plan to run such a large language model on a laptop?’

Lin Yuan was crying over his own stupidity.

After some careful thought, he finally figured out the reason. It was because he had grown accustomed to the model strength outlined in the computing power system.

Lin Yuan was used to the streamlined models produced by the system, habitually overlooking the crude AI model methods currently used by Earth humans.

Following the current extensive route of piling up computing power, wouldn’t the model weight file have to be this large?

Lin Yuan did a quick calculation: the full-blood version of DS-LLM 67B required 268GB of video memory. That means three H100s wouldn’t even be enough! Each H100 has 80GB of video memory, so he would need at least four.

He didn’t plan to buy them; it’s more convenient to rent cloud computing power these days.

“Xiao Zhang,” Lin Yuan called Zhang Yan loudly, “do I need to go through an approval process to buy cloud computing power?”

Since Lin Yuan’s identity was sensitive now and he was being guarded by a security team, all his actions had to be reported in advance.

“What is cloud computing power?”

“It’s similar to buying a cloud server.”

“Oh, then it definitely needs to be reported.”

So Lin Yuan reluctantly began filling out the application form.

“Damn it, what does me buying cloud computing power have to do with my personal safety? Can they just follow the internet cable and hit me?”

“Don’t be silly, rules are rules. If you find it troublesome, I’ll fill it out. Just tell me the purpose.”

“Purpose? The ultimate goal is to short the stock of The Other Shore’s tech companies.”

“Uh…” Zhang Yan obviously couldn’t write that. “I’ll just write… ‘for scientific research, striving to create more achievements for the country and its people’.”

“I just want to short The Other Shore’s tech stocks and really vent my anger. Of course… and make some money along the way.”

“Shut up, stop messing around.”