“FIRE: Financial Independence, Retire Early.”
Week 45
Monday 04/11/2024
There are so many noise prompts in the world, and it is easy to be disturbed by them. I need to learn to filter out the noise and focus on the important things. I need to learn to be patient and persistent. I need to learn to be calm and rational. I need to learn to be confident and decisive. I need to learn to be humble and grateful. I need to learn to be kind and generous. I need to learn to be honest and trustworthy. I need to learn to be responsible and accountable. I need to learn to be disciplined and organized. I need to learn to be creative and innovative. I need to learn to be curious and open-minded. I need to learn to be flexible and adaptable. I need to learn to be resilient and resourceful. I need to learn to be positive and optimistic. I need to learn to be happy and healthy. I need to learn to be successful and fulfilled. I need to learn to be a better person every day.
What I have started so far:
- OCI Generative AI
- Youtube/VinciBits AI
- Spring AI (Watched quite a few videos and demos, quite interesting)
- Skool/Zero to Principal Engineer (A great path to follow)
- Hyperskill/Kotlin(Done several different courses on Coursera, Kotlin Academy, Linkedin)
- Spring Academy/Spring Boot(Done, but want to apply them in a template project steps by steps)
- LinkedIn/GraphQL(Done basic part, but want to continue more advanced topics)
- Youtube/Gradle(Done basic, but want to practice more advanced topics)
They all come from different perspective and I need to focus on one at a time. I should have enough knowledge about Kotlin, Spring and GraphQL to build a simple app. But I want to be expertised in all of them. Which drive me crazy about tutorials but hands-on practice is the key.
The most interesting part is AI related, especially Spring AI is at the early stage which I want to be the one of the first to know and practice. I have know basic knowledge about AI, but I need to know how to apply it in real world, or a real idea that I can put all pieces together.
My Focus for today:
- OCI Generative AI
Wednesday 06/11/2024
- Embedding Models
- Basic idea: convert words into vectors (embeddings, numerical representation).
- Cohere embed-english convert user questions to vector embeddings.
- Cohere embed-multilingual 1024-dimensional vector, max 512 tokens per embedding.
- Cohere embed-english-light 384-dimensional vector, max 512 tokens per embedding.
- etc.
- Prompt Engineering
- In-context learning (task description)
- k-shot Prompting (k samples for the task)
- chain-of-thought (response sample with small reasoning steps)
- least-to-most (easy-first, decompose the problem)
- Customize LLMs with your data
- Fine Tuning and Inference
- Dedicated AI Cluster Sizing and Pricing
- Security
Thursday 07/11/2024
- LEGO Building blocks for an LLM Application
- RAG
- Framework
- Retriever: sources relevant information from a large corpus or database. Provides contextuallly relevant, accurate and up-to-date information.
- Ranker: ranks the retrieved information based on relevance to the user query.
- Generator: generates the final response based on the retrieved and ranked information.
- Techniques
- RAG Sequence
- RAG Token
- Framework
- Vector Databases
- Keyword Search
- Semantic Search
- Oracle Database 23ai
- RAG
Friday 08/11/2024
- 9am - 10am: GraphQL Submit
- Apollo GenAI Toolkit (AI-driven GraphQL):
- https://www.apollographql.com/guides/chatbots
- https://github.com/apollographql/graphchat
- GraphQL Federation
- Apollo GenAI Toolkit (AI-driven GraphQL):