Let me see... Today's crash course was mostly about the history of modern day computers. I'll try to recall as much information as I can without looking it up and practice my English writing.
The History of Computer
The history of computer is believed to be inspired by the punch card loom to expedite the weaving process. Various machines were also created to speed up process, but notably for calculation. These machines are huge, and only capable of performing one specific task. Machines for multitasking were starting to develop for handling multiple tasks and to reduce the bulk of some components, like the vacuum-sealed diode, which was fragile and requires a lot of spaces to suspend it. It led to the creation of transistor, which is a solid part component. It is less prone to damages, and compact. The size reduction gave way to smaller computers.
Binary logic, logic gate
These devices uses binary, and tertiary logic, but it was the mainstream to use binary logic, built on Boolean algebra, to reduce ambiguity.
Memory
There are a few types of memory storage on a computer: cache, RAM, main storage, and external memory. Cache are at the top of the memory hierarchy, with it being the fastest to access, but has the smallest memory. RAM, random accessed memory, is the modern successor of the sequential memory access. It is ranked the 2nd on the memory hierarchy. The connection between the RAM and the CPU is called the bus. The main storage and the external storage have gone through many changes too.
The size reduction happened to memory components and other components. Based on the Moore's Law, the IC would get smaller, the CPU would have more IC on it. Every 2 years, the number of IC on a CPU would double.
With photolithography, the etching can be more refined.
Dirty byte refers to the inconsistency between the cache's and RAM's memory of the same information.
Memory storage
Each program will be allocated spaces needed and more, called memory protection. If a program has been affected either unintentionally, or maliciously, the empty memory spaces between programs will serve as an isolation.
Defragmentation is to put all the associated memories of a file or program nearby.
When you reduces the image, video, or audio details that's not noticeable to human, it is called lossless compression
Processor
Clock is the internal clock used in the CPU to keep track of how fast it is doing calculation to keep the CPU at an optimal speed and temperature. When you go too fast, overclocking it, it will heat up the CPU and might lead to damages.
Time-sharing is when the computer is big and strong and can handle multiple terminals. Yeah.
Programming
Programmers got tired of translating their ideas into machine code, putting onto a punch card, and feeding the cards to the computer, so they got Assembly, a low level programming language.
Algorithm
More programming languages, meaning faster programming and calculation. Programmers wrote algorithm so they can reuse the same thing. With internal memory, they don't have to walk around grabbing punch cards, so they can make things happen faster.
File system
Tree file system. Yeah.
What I don't understand or forgot:
IC
Turing machine
ALU
What was the main storage called?
How did they make SSD?
Which components used photolithography?
Brilliant.org
Tokenization: breaking a sentence into words and punctuation
LLM: language learning model
Corpus: the writing used to train the model
Temperature: the randomness of the generated result
Epoch: the process for training on the text
Loss: the differences between the desired and generated result
Unigram: prediction made without referring the prompt
Bigram: prediction made based on the last word of the prompt
Trigram: prediction made based on the last 2 words of the prompt
Byte-pair encoding: when the program pair 2 letters together. Is there anything about this??
Preprocessing: to make the corpus and prompt easier to process by removing all punctuation and make the sentences lowercased
Parallelism: doing things together!
Pipelineing: doing things together?
Comments
Post a Comment