From 74defe7d3081560ab206d62687815b6db9d6536c Mon Sep 17 00:00:00 2001 From: minhcloud Date: Thu, 21 Mar 2024 09:18:44 +0700 Subject: [PATCH 1/2] chore: update images and formatting --- ...-to-set-up-environment-for-editing-memo.md | 25 +++++++++---------- 1 file changed, 12 insertions(+), 13 deletions(-) diff --git a/_memo/how-to-set-up-environment-for-editing-memo.md b/_memo/how-to-set-up-environment-for-editing-memo.md index 5f7298cf..5ac872c5 100644 --- a/_memo/how-to-set-up-environment-for-editing-memo.md +++ b/_memo/how-to-set-up-environment-for-editing-memo.md @@ -24,33 +24,32 @@ Firstly, you have to install Visual Studio Code, [here](https://code.visualstudi ## B. Install the Devbox 1. Open the Terminal on VScode -You can use the shortcut `Control + ~`. +You can use the shortcut `Control + ~` to open Terminal. -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_bed95d63218ec145199cb308295a2d1e_MD5.webp) +![](https://media.discordapp.net/attachments/1064565585800876083/1217838498464141463/setup_env_b11.png?ex=66057b7c&is=65f3067c&hm=2bfa1ade8635c2e474b8dbb10797186eb0ccca98a835ee4245d0a52e85dece24&=&format=webp&quality=lossless&width=1540&height=1134) -Then run this command in the Terminal `curl -fsSL https://get.jetpack.io/devbox | bash`. +Then run this command in the Terminal to install Devbox: `curl -fsSL https://get.jetpack.io/devbox | bash`. ## C. Pull the Github Source to your local disk You have 2 ways to pull the Github source to the local disk: -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_6f5e3e3ea3303c26882261367dba3c62_MD5.webp) +![ ](https://media.discordapp.net/attachments/1064565585800876083/1217838498984230913/setup_env_b12.png?ex=66057b7c&is=65f3067c&hm=d6af0dc1661e2ebc6154bf1f78516b7c0a4e932bff74c29cb7b34db4ba2938f0&=&format=webp&quality=lossless&width=1618&height=334) ### Method 1: Link VScode with your Github account 1. Connect your github account with the VScode 2. Search repo `note.d.foundation` and select to clone it -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_7d30564bb35c4e7a84ab25efb9863eea_MD5.webp) +![](https://media.discordapp.net/attachments/1064565585800876083/1217838499776958474/setup_env_c11.png?ex=66057b7c&is=65f3067c&hm=3a5b23cafa5bda553f69d16bbfe4d4285cce3179ea2af8ffaa89660f4b17e49d&=&format=webp&quality=lossless&width=1540&height=1134) -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_23304a379655d944f94067137b95bae3_MD5.webp) +![](https://media.discordapp.net/attachments/1064565585800876083/1217838500909551656/setup_env_c12.png?ex=66057b7c&is=65f3067c&hm=3172263a041cb2f2f426fe034539fa7906644c14bcabb542c2389fc7dfba4199&=&format=webp&quality=lossless&width=1540&height=1134) ### Method 2: Using the terminal -1. Run these 2 commands seperately in Terminal to config the account: +1. Run these 2 commands seperately in Terminal to connect the Github account to the VScode: ```sh git config --global user.email "you@example.com" git config --global user.name "Your Name" ``` - -2. Run this command in Terminal +2. Run this command in Terminal to clone the repository: ```sh git clone https://github.com/dwarvesf/note.d.foundation.git ``` @@ -66,12 +65,12 @@ git submodule foreach --recursive 'git checkout main || git checkout master 2. Create folder "content" under node.d.foundation folder -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_8d8eabbbf8f91851e67750ab1d10138e_MD5.webp) +![](https://media.discordapp.net/attachments/1064565585800876083/1217838501937020968/setup_evn_d2.png?ex=66057b7d&is=65f3067d&hm=d24b328ccc8efd196b9754480ff0ccca33c9b4a9359576c2707af1483fd52389&=&format=webp&quality=lossless&width=1540&height=1134) -3. Run the this command in Terminal `devbox shell` and wait until all files are installed -4. Run the command `make watch-run` +3. Run the this command in Terminal `devbox shell` to set up the environment and wait until all files are installed +4. Run the command `make watch-run` to rebuild the site and get the local link ## E. Sync all repo before editting Everytime you want to edit or create a post, you have to go to `Source Control` and sync all file. -![](assets/how-to-set-up-environment-for-editing-memo_how-to-set-up-environment-for-editing-memo_232066febea0d05095e93d6fe091eae1_MD5.webp) +![](https://media.discordapp.net/attachments/1064565585800876083/1217838502977343568/setup_evn_e1.png?ex=66057b7d&is=65f3067d&hm=dbc1332fd9de7ed3d5b49bca3f4ad07784a36ef6629ec0263d65a22976106f55&=&format=webp&quality=lossless&width=1410&height=1040) From e18049532dd8e671dc787b7bd5e762992b79f620 Mon Sep 17 00:00:00 2001 From: minhcloud Date: Fri, 29 Mar 2024 14:15:47 +0700 Subject: [PATCH 2/2] create: market-report-mar-2024 --- _labs/market-report-mar-2024.md | 72 +++++++++++++++++++++++++++++++++ 1 file changed, 72 insertions(+) create mode 100644 _labs/market-report-mar-2024.md diff --git a/_labs/market-report-mar-2024.md b/_labs/market-report-mar-2024.md new file mode 100644 index 00000000..0a60d551 --- /dev/null +++ b/_labs/market-report-mar-2024.md @@ -0,0 +1,72 @@ +--- +tags: + - labs + - market-report + - AI + - LLM +title: Market Report Mar 2024 +date: 2024-03-01 +description: + - monotykamary + - thanh +menu: labs +type: labs +hide_frontmatter: false +pinned: true +hide_title: false +--- + +In this month's market report, we explore the evolving landscape of artificial intelligence, API techniques, toolings, programming languages, and the intersection of design and engineering. Our insights shed light on the dynamic shifts and emerging trends across these domains, highlighting the advancements that are shaping the future of technology and software development. + +## Subtle advances in app design for LLMs pave the way for advance assistants +Apps like [Devin AI](https://preview.devin.ai/), [Devika](https://github.com/stitionai/devika), [GPT-Pilot](https://github.com/Pythagora-io/gpt-pilot) (also backed by YCombinator), and many others are a signal of a more robust AI scene where platforms are now powerful and fast enough to host complex agents. With now many ways to design an app for LLMs, the platforms that surround them are given better peformance, lower latencies, and more robust logic to maintain coherency that allows the designs of multi-agent applications. Libraries like [Langgraph](https://blog.langchain.dev/langgraph-multi-agent-workflows/) and [Autogen](https://github.com/microsoft/autogen) are some of the toolings that have made great steps into complex and stateful AI application design. In addition, there is a ton of research in different styles of application design that we might see grow in the upcoming months, such as [LLMCompiler](https://github.com/SqueezeAILab/LLMCompiler/blob/main/figs/thumbnail.png), [Plan-and-Execute](https://github.com/langchain-ai/langgraph/blob/main/examples/plan-and-execute/plan-and-execute.ipynb), [Reasoning without Observation](https://github.com/langchain-ai/langgraph/blob/main/examples/rewoo/rewoo.ipynb) and AI feedback loops. + +## Open Source AI Repositories: A Surge in Innovation +[Huyen Chip's comprehensive analysis](https://huyenchip.com/2024/03/14/ai-oss.html) of over 845 open-source repositories, each with more than 500 stars, reveals significant insights into the AI tools domain. Following the introduction of transformative technologies like Stable Diffusion and ChatGPT in 2023, there was a noticeable explosion in the creation of new AI tools. This surge began to stabilize by September 2023, indicating a shift in the competitive landscape of generative AI and a more grounded approach to AI development. + +![](https://i.postimg.cc/bv1Xht3d/lab-1.avif) + +### Focused Evolution of AI Infrastructure +In the realm of AI infrastructure, categories such as computing management (e.g., [skypilot](https://arc.net/l/quote/dlhznxrv)), serving (e.g., [vllm](https://github.com/vllm-project/vllm)), and monitoring (e.g., [uptrain](https://github.com/uptrain-ai/uptrain)) have seen steady growth. The explosion of interest in model development is particularly evident in areas related to inference optimization, evaluation, and parameter-efficient finetuning, highlighting a concentrated effort to refine AI operational efficiency. + +### The Rise of Individual-Led Application Development +Application development remains a highly active domain, predominantly driven by individual developers. This segment covers a diverse range of applications, including coding tools, bots, and information aggregation solutions. Interestingly, tools centered around prompt engineering, AI interfaces, agents, and AI engineering frameworks have gained popularity. Applications initiated by individuals tend to attract more attention than those launched by organizations, suggesting the potential for valuable one-person companies in the AI space. + +### Dominance of Tech Giants in AI Contributions +An analysis of GitHub accounts reveals that 19 out of the top 20 AI contributors are from leading technology companies like Google, OpenAI, and Microsoft, with a significant presence of Chinese developers. This dominance underscores the significant resources and influence these entities have in shaping the AI ecosystem. + +### Rapid Development and Visibility of AI Projects +The AI domain has witnessed projects that quickly capture significant attention, only to see interest wane over time. However, the pace at which developers are releasing new AI tools demonstrates an impressive ability to innovate rapidly. + +## API Techniques and Tooling +### Advancements in Model Training and Compression +- **Retrieval Augmented Fine Tuning ([RAFT](https://techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a-new-way-to-teach-llms-to-be-better-at-rag/ba-p/4084674))**: This technique aims to enhance Large Language Models' (LLMs) performance by "pre-studying" relevant documents, improving their Retrieval-Augmented Generation (RAG) capabilities. +- **Long Context Models**: The view towards using [long-context models](https://twitter.com/amanrsanger/status/1772742457937060288?utm_source=ainews&utm_medium=email&utm_campaign=ainews-dbrx-best-open-model-but-not-most-efficient) with extensive custom prompts could potentially eliminate the need for traditional fine-tuning, marking a significant evolution in handling new knowledge within LLMs. +- **Model Compression**: The focus on model compression reflects the necessity to manage latency and costs effectively. The industry has moved from 16-bit to 2-bit, and recent research on [1-bit](https://arxiv.org/abs/2402.17764) quantization, highlighting the ongoing efforts to optimize model efficiency. + +### Scalable Vector Database for Enhanced LLM Applications +The Scalable Vector Database emerges as a crucial solution to challenges associated with long-term memory and long-range context dependency in LLM applications. The demand for high-performance vector databases is on the rise, underscoring the importance of advanced indexing algorithms for efficient data retrieval. + +![](https://i.postimg.cc/fRG4pK76/labs-2.avif) + +## AI Startups breaking the VC barrier +There are a lot of growing startups that are making the scene with more compelling apps. Apps like [Patchwork](https://www.atpatchwork.com/), [PointOne](https://pointone.ai/) backed by YCombinator - and growing apps on ProductHunt like [Saner.AI](https://www.producthunt.com/products/saner-ai), [Vapi](https://www.producthunt.com/products/vapi). Domains like Law, Medicine, Support Calling have their own set of challenges and although there isn't really any new technology in the AI space, disciplines in organizing and transforming data for use with AI has brought nuance and complexity to these apps that make them differentiate with other software. + +## Other Notable Trends +- **Rust Adoption by Google and Microsoft**: While Google advocates for Rust to address [memory safety vulnerabilities](https://security.googleblog.com/2024/03/secure-by-design-googles-perspective-on.html), Microsoft offers [resources](https://microsoft.github.io/rust-for-dotnet-devs/latest/introduction.html) for .NET developers to learn Rust. +- **Emergence of Design Engineers**: The role of design engineers, who bridge the gap between design and engineering, is becoming increasingly prominent. They are poised to lead in areas such as product architecture, design infrastructure, and R&D. +- **TailwindCSS v4 Alpha Release**: The [new version](https://tailwindcss.com/blog/tailwindcss-v4-alpha), rebuilt with Rust and integrated with the Lightning CSS parser, promises a significant performance boost, making it ten times faster than its predecessor. + +## References +- https://techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a-new-way-to-teach-llms-to-be-better-at-rag/ba-p/4084674 +- https://huyenchip.com/2024/03/14/ai-oss.html +- https://gorilla.cs.berkeley.edu/blogs/9_raft.html +- https://www.gartner.com/en/articles/30-emerging-technologies-that-will-guide-your-business-decisions +- https://twitter.com/cognition_labs/status/1767548763134964000 +- twitter.com/amanrsanger/status/1772742457937060288 +- https://twitter.com/llama_index/status/1772662480210198809 +- https://arxiv.org/abs/2402.17764 +- https://security.googleblog.com/2024/03/secure-by-design-googles-perspective-on.html +- https://microsoft.github.io/rust-for-dotnet-devs/latest/introduction.html +- https://maggieappleton.com/design-engineer +- https://www.proofofconcept.pub/p/design-engineering \ No newline at end of file