Awesome List Updates on May 13 - May 19, 2024

52 awesome lists updated this week.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Zig

System tools / Messaging

• weskoerber/mac_address (⭐2) - A cross-platform library to retrieve the MAC address from your network interfaces without libc.

2. Awesome Go

Continuous Integration

• go-beautiful-html-coverage (⭐7) - A GitHub Action to track code coverage in your pull requests, with a beautiful HTML preview, for free.

Embeddable Scripting Languages

• Wa/凹语言 (⭐1k) - The Wa Programming Language embedded in Go.

Security

• multikey (⭐5) - An n-out-of-N keys encryption/decryption framework based on Shamir's Secret Sharing algorithm.

3. Awesome Low Code

Platforms / Business Process Management

• Naologic - Productivity apps built by business users and process-driven professionals to simplify and automate complex processes.

4. Awesome Lowcode

Visual programming

• Lowcoder - A low-code platform that allows users to build custom software applications with minimal coding

5. Urban and Regional Planning Resources

Public Data Resources / Climate

• National Stormwater Calculator - An EPA resource including different features and controls for planning, pricing out projects that also shows the outcomes of stormwater retention interventions based on green infrastructure decisions.

Public Data Resources / Environment and Ecosystem Services

• American Conservation and Stewardship Atlas - An interagency resource intended to help illustrate and document locally led, partnership-driven conservation and restoration work that is underway in communities across America.

• National Biogeographic Map - A platform maintained by the United States Geological Survey (USGS) that provides a platform for analysis of questions about what species are where, how well protected they are, how vulnerable they are to stressors, and what management options will have the greatest benefit for conservation of biodiversity. Additional Links: More Information about the Tool

Platforms and Software Resources / AI in Planning Tools and Platforms

• Tune Studio - Playground for software developers to finetune and deploy large language models.

6. Awesome Machine Learning

Tools / Misc

• Wallaroo.AI - Production AI plaftorm for deploying, managing, and observing any model at scale across any envirorment from cloud to edge. Let's you go from python notebook to inferencing in minutes.

7. Awesome Datascience

Free Courses

• Prompt Engineering for Vision Models - Learn to prompt cutting-edge computer vision models with natural language, coordinate points, bounding boxes, segmentation masks, and even other images in this free course from DeepLearning.AI.

8. Awesome Db Tools

Schema / Diagrams

• DrawDB (⭐12k) - Free, simple, and intuitive online database design tool and SQL generator.

9. ALL About RSS

Terminal-based / programmable RSS readers / Outline Processor Markup Language

• Syndicationd (⭐79): a TUI feed viewer written in Rust ¹⁴⁶¹

10. Awesome Qubes OS

Downloading, Installing, Upgrading, and Building

• Qubes OS 4.2.1 - Qubes OS 4.2.1 download.

• Qubes OS 4.2.2 Weekly Builds - Qubes OS 4.2 Weekly Build download.

11. Awesome Sitecore

Configuration

• XDT Transform playground) - A playground IDE for you to play/test XDT Transformation of .NET config wiles.

12. Awesome Prisma

🦺 Community Prisma Tools

• Prisma Audit Trails (⭐64)

• prisma-ast - A Builder object to programmatically query and edit your schema.prisma files (⭐124)

13. Awesome Generative Deep Art

Ethics, Philosophical questions and Discussions about Generative AI

• Generative AI Ethics: 8 Biggest Concerns and Risks

Online Tools and Applications

• StartKit.AI: Boilerplate for quickly building AI products

14. Awesome Blazor

2D/3D Rendering engines / Others

• Blazor Transition Group (⭐25) - A library performing animations when a Blazor component enters or leaves the DOM inspired by react-transition-group (⭐10k).

Tools & Utilities / Others

• Memento (⭐36) - A simple client-side state management container for Blazor/.NET includes redo/undo and ReduxDevTools support.

• RxBlazorLight (⭐5) - RxBlazorLight is a simple reactive wrapper around Blazor components. For now only MudBlazor components are supported. Build the RxMudBlazorLightSample (⭐5) and enjoy the reactive Components (⭐5).

Others / Others

• Blazork8s (⭐140) - Manage k8s using balzor with AI,like kubernetes dashboard.

Videos / Others

• Learn C# with CSharpFritz - PWA and Publishing with Blazor - May 1, 2024 - Fritz wraps up the series on Blazor with .NET 8 by enabling the pizza website as a progressive web app (PWA) and publishes it to Microsoft Azure.

• Introducing Smart Components Experiment for Blazor, MVC, and Razor Pages - March 19, 2024 - Add genuinely useful AI-powered features to your web app, just by dropping in pre-built Smart Components that upgrade your existing pages and forms in minutes. Steve Sanderson shows how SmartPaste, SmartTextArea, and SmartComboBox can all delight your users and make them more productive. This is a new experiment from the .NET team, and they want feedbacks.

• Let's Learn .NET - Blazor - January 25, 2024 - Live with the lead Blazor Product Manager, Daniel Roth, we will learn about basic web development with .NET Blazor! Then, build an interactive web-based game application with Blazor. Come to learn something new and leave with something that we all built, together, live with experts.

15. Awesome Cryptography

Rust / Git

• AEADs (⭐666) - Authenticated Encryption with Associated Data Algorithms: high-level encryption ciphers.

• dryoc (⭐247) - A pure-Rust, general purpose crypto library that implements libsodium primitives.

• elliptic-curves (⭐622) - Collection of pure Rust elliptic curve implementations: NIST P-224, P-256, P-384, P-521, secp256k1, SM2.

• formats (⭐227) - Cryptography-related format encoders/decoders: DER, PEM, PKCS, PKIX.

• hashes (⭐1.7k) - Collection of cryptographic hash functions written in pure Rust.

• password-hashes (⭐602) - Collection of password hashing algorithms, otherwise known as password-based key derivation functions, written in pure Rust.

• signatures (⭐439) - Cryptographic signature algorithms: DSA, ECDSA, Ed25519.

• snow (⭐861) - Pure Rust implementation of Trevor Perrin’s Noise Protocol.

16. Awesome Cpp

Game Engine

• Axmol Engine (⭐819) - A cross-platform game engine for desktop, mobile, and XBOX (UWP), derived from Cocos2d-x-4.0. [MIT] website

Integrated Development Environment

• C Playground - Online C Programming IDE - An online IDE to practice C Programming where you can write, edit, and run code online.

17. Awesome Electron

Closed Source / Other

• OpenSFTP - Integrated SSH and SFTP workspace client.

18. Awesome Game Remakes

FPS

• ClassiCube (⭐1.2k) - Minecraft Classic compatible client written in C from scratch. 🎴

• Doomsday Engine (⭐260) - Source port of id Software's DOOM I/II and Raven Software's Heretic and Hexen. 🎴

Online

• 2004scape - A free & open-source remake of 2004 era RuneScape 2. 🎴

• OpenRSC - Open source accurate RuneScape Classic (2001-2003) game server in Java, based on recorded data and videos. 🎴

• RSC-C (⭐67) - Rewrite of the RuneScape Classic (2001-2003) game client in portable C. 🎴

Strategy

• Ancient Beast (⭐1.6k) - Spiritual successor to Heroes of Might and Magic III focusing on combat; matched based eSport.

19. Awesome Yew

Projects

• Kiomet (⭐64) - An online real-time strategy game in which you expand your territory by capturing towers.

• PinePods (⭐105) - PinePods is a Rust based podcast management system that manages podcasts with multi-user support and relies on a central database with clients to connect to it.

• 0721 (⭐9) - The engine of image hosting written in Rust.

• Hikari (⭐18) - The Frontend of Everything.

• simply-view-image-for-python-debugging (⭐47) - Visual studio code extension simply view the image of the image variables when debugging python.

• Mindsweeper (⭐62) - A principled take on minesweeper, Live Demo.

• scap-rs (⭐15) - National Vulnerability Database (NVD) implemented by Rust, Live Demo.

• Sentry Relay (⭐297) - The Sentry Relay is a service that pushes some functionality from the Sentry SDKs as well as the Sentry server into a proxy process.

• Syre (⭐10) - Scientific data management and insights.

• candle-wasm-examples (⭐14k) - Candle is a minimalist ML framework for Rust with a focus on performance (including GPU support) and ease of use. Try our online demos: whisper, LLaMA2, T5, yolo, Segment Anything.

• chipbox (⭐40) - chipbox is an open-source desktop DAW written in Rust.

• Taxy (⭐54) - A reverse proxy server with built-in WebUI, supporting TCP/HTTP/TLS/WebSocket, written in Rust.

• Proxelar (⭐357) - Rust-based Man in the Middle proxy, an early-stage project aimed at providing visibility into network traffic.

• diff.rs (⭐85) - Web application to render a diff between Rust crate versions. Implemented in Yew, runs fully in the browser as WebAssembly, Live Demo.

Alternatives / Frameworks

• Leptos (⭐15k) - Build fast web applications with Rust.

20. Awesome Ci

• Name: Laminar CI (⭐289)

  Description: Fast and lightweight Continuous Integration

  Features: Languages: any

  Supported repositories:

  Documentation: Documentation

  Price: GPL-3.0 license

  Stars:

21. Awesome Ai4lam

Tools and Frameworks / Document analysis, transcription, and labeling

• Arkindex – open-source platform for managing & processing collections of digitized documents

22. Awesome Polars

Resources / Talks and videos

• Polars - An Optimized Dataframe Library ⏳ 84 min - A video that compares the main features of Polars with those of Pandas, with a focus on speeding up your data pipeline by @mattharrison.

• DataFrames on steroids with Polars ⏳ 42 min - A video that demonstrates Polars for Python and shows how much faster it is compared to pandas while remaining just as convenient by @prosoitos. Slides are available here.

23. Awesome Langchain

Other LLM Frameworks / Videos Playlists

• Llmware (⭐4.4k): Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.

• Pipecat (⭐2.8k): Open Source framework for voice and multimodal conversational AI.

• Phidata (⭐11k): Build AI Assistants with memory, knowledge and tools.

24. Awesome Remote Job

Job boards

• CyberJobHunt.in - Explore Cyber Security Jobs in top Companies and Startups.

• Dataaxy Job board and reverse job board specialized in Data and AI in North America

• Freel Freelancers job board in Canada

Job boards aggregators

• SlashJobs - Remote dev jobs aggregator. and/or/not filters, location search, fast, no sign-up/login.

Companies with "remote DNA"

• Prosopo - Bot protection & web security company. Fully remote team based in UK. Typescript, Rust, Open Source.

25. Awesome Agi Cocosci

Domain Specific Language / DSL Program Synthesis

• DreamCoder: growing generalizable, interpretable knowledge with wake–sleep Bayesian program learning - Philosophical Transactions of the Royal Society A, 2023. [All Versions]. [Preprint]. This paper presents DreamCoder, a system that learns to solve problems by writing programs. It builds expertise by creating domain-specific programming languages for expressing domain concepts, together with neural networks to guide the search for programs within these languages. A ‘wake–sleep’ learning algorithm alternately extends the language with new symbolic abstractions and trains the neural network on imagined and replayed problems. DreamCoder solves both classic inductive programming tasks and creative tasks such as drawing pictures and building scenes.

26. Awesome K6

Articles

• Best practices organizing performance testing projects with k6 - Guidelines to scale your performance testing across multiple teams and projects.
  • Part 2 - JavaScript tools, shared libraries, and TypeScript - Stting up your k6 performance testing suite with JavaScript tools, shared libraries, and TypeScript.

27. Awesome Testing

Software / Make your life easier

• Zato API Test - API testing in pure English. No programming needed. Implemented and extendable in Python.

28. Awesome Keycloak

Discussion Groups and Mailing Lists

• Inactive - Keycloak Developer Chat

• GitHub Discussions (⭐21k)

• CNCF Slack, #keycloak, #keycloak-dev

Articles

• Writing Keycloak Extensions: Key Concepts and Anti-Patterns

• Keycloak Multi-Tenancy and the Pulumi Automation API: Part 1

• Instant User Management, SSO, and Secure Pages for ReactJS

• Securing a Next.js Application with Keycloak

• Django Web Authentication with Keycloak

Video Playlists

• KeycloakDevDay 2024 by dasniko

Community Extensions

• Admin Portal for User and Organization management by p2-inc (⭐18)

• Email Notifications when login from a new IP and Login History (⭐5)

• Keycloak Authenticator for Duo's Universal Prompt (⭐49)

• Keycloak extension for creating multi-tenant IAM for B2B SaaS applications (⭐104)

Integrations

• Keycloak Provider for Laravel's Socialite Plugin

• mantelo (Python Admin Client) (⭐14)

Themes

• Keycloak login theme template (⭐36)

• Extension for runtime loading of CSS themes (⭐28)

• 3 CSS-only Keycloak theme examples (⭐28)

Docker

• Keycloak with CRDB Support (CockroachDB)

Tools

• Keycloak RestAPI Postman Collection

Example Projects

• FIDO2 with Keycloak for 1FA and 2FA christian-2/oidc-passkey (⭐3)

• A simple Django app to use Keycloak over OIDC by Amsterdam/keycloak_oidc (⭐21)

Commercial Offerings

• Red Hat build of Keycloak

• Phase Two Keycloak hosting and on-prem Keycloak support

• Skycloak

29. Awesome Billing

Pricing

• SaaS pricing explorer - A collection of 1000+ pricing pages for inspiration.

History / Cloud providers

• Graphic methods for presenting facts - A way to optimize pricing using a physical model made in plaster of Paris, from 1914.

30. Awesome Engineering Team Management

Cognitive Tools / Behavioral

• Programmer Interrupted - Research shows the devastating effect of interrupting developers: 1. 15 min is required to resume work; 2. A programmer get just one uninterrupted 2-hour session in a day; 3. Worst time to interrupt: during edits, searches & comprehension.

31. Awesome Ios Books

Swift

• Swift Gems by Natalia Panferova

Contributors

• Matthaus Woolard

32. Awesome Mirth

Mirth Extensions

• 🔧 Mirth Connect Privacy Plugin (⭐15) - This plugin for Mirth Connect performs two functions to prevent exposing details of your server and Personal Data to NextGen Healthcare.

Tutorials

• 📝 Code template for TLS (⭐11) - For users without the TLS plugin, this code template library uses stunnel to enable in and outbound TLS connections. It is an attempt to ease the configuration of stunnel and do it on the fly.

• 📝 Create SOAP WebService - French article to create a custom SOAP Webservice with java

33. Awesome Devsecops

Articles

• DevSecOps: Making Security Central To Your DevOps Pipeline - Spacelift - An article explains what DevSecOps aims to achieve, why it’s advantageous, and how the DevSecOps lifecycle looks.

Communities

• TAG Security - Cloud Native Computing Foundation - TAG Security facilitates collaboration to discover and produce resources that enable secure access, policy control, and safety for operators, administrators, developers, and end-users across the cloud native ecosystem.

Dependency Management

• Snyk Open Source - Snyk - Automated vulnerable dependency monitoring and upgrades using Snyk's dedicated vulnerability database.

Infrastructure as Code Analysis / Containers

• Grype (⭐8.2k) - Anchore - An easy-to-integrate open source vulnerability scanning tool for container images and filesystems.

Intentionally Vulnerable Applications / Ansible

• Kubernetes Goat (⭐4.1k) - Madhu Akula - Intentionally vulnerable cluster environment to learn and practice Kubernetes security.

• Pentest-Ground - Pentest-Tools.com - Pentest-Ground is a free playground with deliberately vulnerable web applications and network services.

• WrongSecrets (⭐1.2k) - OWASP - Vulnerable app with examples showing how to not use secrets

Monitoring / Ansible

• Streamdal - Streamdal - Embed privacy controls in your application code to detect and monitor PII as it enters and leaves your systems, preventing it from reaching unintended databases, data streams, or pipelines.

Static Analysis / Configuration Files

• Selefra (⭐513) - Selefra - An open-source policy-as-code software that provides analytics for multi-cloud and SaaS.

Supply Chain Security / Ruby

• Overlay (⭐213) - SCAR - a browser extension helping developers evaluate open source packages before picking them.

• Syft (⭐5.8k) - Anchore - A CLI tool for generating a Software Bill of Materials (SBOM) from container images and filesystems.

Related Lists / Ruby

• Awesome Platform Engineering (⭐305) - A curated list of solutions, tools and resources for Platform Engineering

34. Awesome Elixir

Miscellaneous

• ex_azure_speech (⭐3) - An Elixir SDK implementation for the Microsoft Azure Speech Service.

Queue

• honeycomb (⭐18) - Another scheduling system, focusing on the collection of results for one-time tasks.

Release Management

• expublish (⭐22) - Automates semantic release versioning and best practices for elixir packages.

35. Awesome Docker

API Client / Other

• docker-controller-bot (⭐114) - Telegram bot to control docker containers. By @dgongut

36. Awesome Integration

Resources / Articles

• API-Security-Checklist (⭐22k) (⭐22k) - Best practices about REST API security.

37. Awesome Translations

Tools / Automatic translation for end users

• Alexa Translations - Alexa Translations A.I. brings leading AI and machine translation to the legal, financial and government sectors.

Tools / Other tools

• Ninja i18n - A GitHub action for translation linting in pull requests.

38. Awesome Open Source Supporters

Monitoring

• WebGazer requires-approval - Uptime and cron job monitoring with hosted status pages.

39. Awesome Plotters

Software / Vector Creation

• ThreadPlotter (⭐32) - "A toolkit for the design and fabrication of delicate punch needle embroidery using X-Y plotters".

Inspiration, Instruction, and Research / Fonts

• Flatulence, Crystals, and Happy Little Accidents by Nick Fitzgerald (RustConf 2019) - A RustConf talk with very little Rust, more about the creative process of generative art and pen plotters.

• Recreating Retro Plotter Art, by Sher Minn (Plotter People #1) - Conference talk with lots of great computer and plotter history.

• 20+ Questions About My Plotter Painting Practice - Q&A blog post with lots of details about more painterly plotting.

• How to Watercolor Paint with a Robotic Drawing Machine: An Interview with Licia He

• 300 Days with Plotters - Blog post by Licia He about a successful 100 day plotting challenge.

• Roland DXY 1300 Plotter Self Test

• Vintage Aritma 0507 Plotter drawing Sierpinski triangles in one stroke - Aritma Minigraf 0507 video.

• Plotter (Artima Minigraf 0507)

• https://jiristepanovsky.cz/project.php?p=13plotter - Blog post on the Aritma Minigraf 0507 plotter from Czechoslovakia.

• Another drawing on Aritma Minigraf 0507

• Aritma Minigraf 0507 Plotting Space Shuttle

• Drawing an Etch-Mask Directly onto a PCB using a Vintage Plotter - The video description has some interesting details about this plotter.

• OrCAD 386 and a plotter Colorgraf Aritma 512 - Article about using a Colorgraf 512 plotter with OrCAD 386 for making printed circuit boards.

Manuals, Ephemera, Papers, and Patents / Manuals

• Aritma Colorgraf 512 - Website with scanned schematics and manual.

40. Awesome Storybook

Examples

• Recharts

41. Awesome Magento2

Tools

• Mage Wizard (⭐11) - Local web UI to view and create automatically modules, plugins, configs, observers, commands, crontabs, etc. directly in Magento 2 codebase

42. Awesome Godot

Templates / Godot 4.2+

• Maaack's Game Template (⭐361) - Template with a main menu, options menus, pause menu, credits, scene loader, extra tools, and an example game scene.

Plugins and scripts / Godot 4.2+

• Maaack's Game Template Plugin (⭐361) - Template with a main menu, options menus, pause menu, credits, scene loader, extra tools, and an example game scene.

• Maaack's Menus Template (⭐112) - Template with a main menu, options menus, credits, and a scene loader.

• Maaack's Scene Loader (⭐18) - Scene loader that includes a loading screen, progress bar, and error handling.

43. Awesome Vue

Projects Using Vue.js / Open Source

• YesPlayMusic (⭐28k) - High-looking third-party NetEase cloud player, support Windows / macOS / Linux :electron:

• douyin (⭐8.8k) - Imitate TikTok ，Vue Best practices on Mobile

Components & Libraries / Frameworks

• gin-vue-admin (⭐21k) - 🚀Vite+Vue3+Gin development basic platform. Live demo

Components & Libraries / UI Components

• vue-echarts (⭐9.6k) - Vue.js component for Apache ECharts™.

Components & Libraries / UI Utilities

• unplugin-vue-router (⭐1.5k) - Next Generation file based typed routing for Vue Router.

• vue-starport (⭐1.8k) 🛰 Shared component across routes with animations

Components & Libraries / Dev Tools

• Vue - Official (Volar) (⭐5.7k) - ⚡The Fastest Vue Language Support Extension

Components & Libraries / Scaffold

• vue-x-platforms (⭐16) - Vue running on Web, iOS, Android and Vision Pro.

44. Awesome Tmux

Tools and session management

• tome (⭐35) 🔁 Playbooks for tmux & vim, replacing your shell history

45. Free for Dev

Education and Career Development

• DeepLearning.AI Short Courses - Free short courses from industry-leading experts to get hands-on experience with the latest generative AI tools and techniques in an hour or less.

PaaS

• ampt.dev - Ampt lets teams build, deploy, and scale JavaScript apps on AWS without complicated configs or managing infrastructure. Free Preview plan includes 500 invocations hourly, 2,500 invocations daily and 50,000 invocations monthly. Custom domains are allowed only in the paid plans.

Design and UI

• movingpencils.com — Fast, browser-based vector editor. Completely free.

Analytics, Events and Statistics

• AppFit - AppFit is a comprehensive analytics and product management tool designed to facilitate seamless, cross-platform management of analytics and product updates. Free plan includes 10,000 events per month, product journal and weekly insights.

Other Free Resources

• Wikimint Developer - Always free tools for web developers that includes CSS minify unminify, image optimizer, image resizer, case convertor, CSS validator, JavaScript compiler, HTML editor, etc.

46. Awesome Playcanvas

Browser Games

• Build Land - Grow your island by collecting resources.

• Virtual Voodoo - Voodoo doll simulator.

Product Configurators

• Norqain - Watch configurator.

47. Awesome Vite

Templates / React

• React Tanning (⭐3) - Starter template with React + Vite + TypeScript + TanStack + Tailwind.

Framework-agnostic Plugins / Loaders

• vite-plugin-dir2json (⭐9) - Convert the directory structure into json data containing supported file paths.

Framework-agnostic Plugins / Helpers

• vite-plugin-serve-static (⭐6) - Allows serving arbitrary static files not in the public/ directory.

Vue / Loaders

• vite-plugin-style-vw-loader (⭐6) - Converting the inline style px to vw.

PHP / Community

• PHP-Vite (⭐20) - Integration for PHP, Composer package, no framework dependencies.

Apps/Websites / Community

• Dataviz Explorer (⭐15) - A tool for large CSV, database, and real-time visualization with interactive plots using Highcharts, Chart.js, React, JavaScript, Material UI and GitHub Actions with Coverage Report.

48. Awesome Terraform

Self-Hosted Registries / Miscellaneous

• terralist (⭐307) - Terraform Private Registry for modules and providers manageable from a REST API.

Providers / Community providers

• terraform-provider-uname (⭐4) - Uname Provider for Terraform.

Tools / Community providers

• library.tf - Library.tf is built and designed to not just provide you with all of the registry information for Terraform and OpenTofu but to provide all of the insights you need to make decisions. Quickly find modules or providers that are supported and maintained and not full of bugs.

49. Awesome Azure Openai Llm

Vector Database Comparison

• Milvus (A cloud-native vector database) Embedded git (⭐29k) [Sep 2019]: Alternative option to replace PineCone and Redis Search in OSS. It offers support for multiple languages, addresses the limitations of RedisSearch, and provides cloud scalability and high reliability with Kubernetes.

• Pinecone: A fully managed cloud Vector Database. Commercial Product [Jan 2021]

• Weaviate (⭐11k): Store both vectors and data objects. [Jan 2021]

• Chroma (⭐14k): Open-source embedding database [Oct 2022]

• Qdrant (⭐20k): Written in Rust. Qdrant (read: quadrant) [May 2020]

• Redis extension for vector search, RedisVL (⭐200): Redis Vector Library (RedisVL) [Nov 2022]

• A SQLite extension for efficient vector search, based on Faiss! (⭐1.7k) [Jan 2023]

Microsoft Azure OpenAI relevant LLM Framework / Lucene based search engine with OpenAI Embedding

• SAMMO (⭐301): A general-purpose framework for prompt optimization. ref [April 2024]

LangChain chain type: Chains & Summarizer / DSPy optimizer

• Chains ref (⭐0)
  • SimpleSequentialChain: A sequence of steps with single input and output. Output of one step is input for the next.
  • SequentialChain: Like SimpleSequentialChain but handles multiple inputs and outputs at each step.
  • MultiPromptChain: Routes inputs to specialized sub-chains based on content. Ideal for different prompts for different tasks.

• Summarizer
  • stuff: Sends everything at once in LLM. If it's too long, an error will occur.
  • map_reduce: Summarizes by dividing and then summarizing the entire summary.
  • refine: (Summary + Next document) => Summary
  • map_rerank: Ranks by score and summarizes to important points.

Prompt Engineering / Prompt Template Language

• Many-Shot In-Context Learning: Transitioning from few-shot to many-shot In-Context Learning (ICL) can lead to significant performance gains across a wide variety of generative and discriminative tasks [17 Apr 2024]

Prompt Tuner / Prompt Template Language

• Claude Prompt Engineer (⭐9.2k): Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best. [4 Jul 2023] / Anthropic Helper metaprompt ref / Claude Sonnet 3.5 for Coding

Prompt Guide & Leaked prompts / Prompt Template Language

• Awesome ChatGPT Prompts (⭐108k) [Dec 2022]

• Awesome Prompt Engineering (⭐3.6k) [Feb 2023]

• Awesome-GPTs-Prompts (⭐4.9k) [Jan 2024]

• Leaked prompts of GPTs (⭐28k) [Nov 2023] and Agents (⭐7.9k) [Nov 2023]

Memory Optimization / Llama Finetuning

• Transformer cache key-value tensors of context tokens into GPU memory to facilitate fast generation of the next token. However, these caches occupy significant GPU memory. The unpredictable nature of cache size, due to the variability in the length of each request, exacerbates the issue, resulting in significant memory fragmentation in the absence of a suitable memory management mechanism.

• To alleviate this issue, PagedAttention was proposed to store the KV cache in non-contiguous memory spaces. It partitions the KV cache of each sequence into multiple blocks, with each block containing the keys and values for a fixed number of tokens.

• PagedAttention : vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention, 24x Faster LLM Inference doc. ref [12 Sep 2023]

  
  • PagedAttention for a prompt “the cat is sleeping in the kitchen and the dog is”. Key-Value pairs of tensors for attention computation are stored in virtual contiguous blocks mapped to non-contiguous blocks in the GPU memory.

• TokenAttention (⭐2.2k) an attention mechanism that manages key and value caching at the token level. git (⭐2.2k) [Jul 2023]

• Flash Attention: [cnt] [27 May 2022] / FlashAttention-2: [cnt] [17 Jul 2023]: An method that reorders the attention computation and leverages classical techniques (tiling, recomputation). Instead of storing each intermediate result, use kernel fusion and run every operation in a single kernel in order to avoid memory read/write overhead. git (⭐13k) -> Compared to a standard attention implementation in PyTorch, FlashAttention-2 can be up to 9x faster / FlashAttention-3 [11 Jul 2024]

Other techniques and LLM patterns / Llama Finetuning

• Better & Faster Large Language Models via Multi-token Prediction: Suggest that training language models to predict multiple future tokens at once [30 Apr 2024]

OpenAI's Roadmap and Products / OpenAI's plans according to Sam Altman

• Model Spec: Desired behavior for the models in the OpenAI API and ChatGPT ref [8 May 2024] ref: takeaway

OpenAI's Roadmap and Products / GPT series release date

• GPT-4o: o stands for Omni. 50% cheaper. 2x faster. Multimodal input and output capabilities (text, audio, vision). supports 50 languages. [13 May 2024] / GPT-4o mini: 15 cents per million input tokens, 60 cents per million output tokens, MMLU of 82%, and fast. [18 Jul 2024]

Context constraints / GPT series release date

• Introducing 100K Context Windows: hundreds of pages, Around 75,000 words; [11 May 2023] demo Anthropic Claude

• “Needle in a Haystack” Analysis [21 Nov 2023]: Context Window Benchmarks; Claude 2.1 (200K Context Window) vs GPT-4 (⭐1.4k); Long context prompting for Claude 2.1 adding just one sentence, “Here is the most relevant sentence in the context:”, to the prompt resulted in near complete fidelity throughout Claude 2.1’s 200K context window. [6 Dec 2023]

• Rotary Positional Embedding (RoPE): [cnt] / ref / doc [20 Apr 2021]
  • How is this different from the sinusoidal embeddings used in "Attention is All You Need"?
    1. Sinusoidal embeddings apply to each coordinate individually, while rotary embeddings mix pairs of coordinates
    2. Sinusoidal embeddings add a cos or sin term, while rotary embeddings use a multiplicative factor.
    3. Rotary embeddings are applied to positional encoding to K and V, not to the input embeddings.

• Lost in the Middle: How Language Models Use Long Contexts: [cnt] [6 Jul 2023]
  1. Best Performace when relevant information is at beginning
  2. Too many retrieved documents will harm performance
  3. Performacnce decreases with an increase in context

• Structured Prompting: Scaling In-Context Learning to 1,000 Examples: [cnt] [13 Dec 2022]
  1. Microsoft's Structured Prompting allows thousands of examples, by first concatenating examples into groups, then inputting each group into the LM. The hidden key and value vectors of the LM's attention modules are cached. Finally, when the user's unaltered input prompt is passed to the LM, the cached attention vectors are injected into the hidden layers of the LM.
  2. This approach wouldn't work with OpenAI's closed models. because this needs to access [keys] and [values] in the transformer internals, which they do not expose. You could implement yourself on OSS ones. cite [07 Feb 2023]

• Ring Attention: [cnt]: 1. Ring Attention, which leverages blockwise computation of self-attention to distribute long sequences across multiple devices while overlapping the communication of key-value blocks with the computation of blockwise attention. 2. Ring Attention can reduce the memory requirements of Transformers, enabling us to train more than 500 times longer sequence than prior memory efficient state-of-the-arts and enables the training of sequences that exceed 100 million in length without making approximations to attention. 3. we propose an enhancement to the blockwise parallel transformers (BPT) framework. git (⭐595) [3 Oct 2023]

• LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning. With only four lines of code modification, the proposed method can effortlessly extend existing LLMs' context window without any fine-tuning. [2 Jan 2024]

• Giraffe: Adventures in Expanding Context Lengths in LLMs. A new truncation strategy for modifying the basis for the position encoding. ref [2 Jan 2024]

• Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention. The Infini-attention incorporates a compressive memory into the vanilla attention mechanism. Integrate attention from both local and global attention. [10 Apr 2024]

Trustworthy, Safe and Secure LLM / GPT series release date

• Trustworthy LLMs: [cnt]: Comprehensive overview for assessing LLM trustworthiness; Reliability, safety, fairness, resistance to misuse, explainability and reasoning, adherence to social norms, and robustness. [10 Aug 2023]

GPT for Domain Specific / GPT series release date

• TimeGPT: The First Foundation Model for Time Series Forecasting git (⭐2.9k) [Mar 2023]

• BioGPT: [cnt]: Generative Pre-trained Transformer for Biomedical Text Generation and Mining git (⭐4.3k) [19 Oct 2022]

• MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers [27 Nov 2023]

• BloombergGPT: A Large Language Model for Finance [30 Mar 2023]

• Galactica: A Large Language Model for Science [16 Nov 2022]

• EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain [30 Jan 2024]

• SaulLM-7B: A pioneering Large Language Model for Law [6 Mar 2024]

• Huggingface StarCoder: A State-of-the-Art LLM for Code: git [May 2023]

• Code Llama: Built on top of Llama 2, free for research and commercial use. ref / git (⭐16k) [24 Aug 2023]

• Devin AI: Devin is an AI software engineer developed by Cognition AI [12 Mar 2024]

• OpenDevin: an open-source project aiming to replicate Devin [Mar 2024]

• FrugalGPT: LLM with budget constraints, requests are cascaded from low-cost to high-cost LLMs. git (⭐165) [9 May 2023]

MLLM (multimodal large language model) / GPT series release date

• Vision capability to a LLM ref [22 Aug 2023]

  • The model has three sub-models:

    1. A model to obtain image embeddings
    2. A text model to obtain text embeddings
    3. A model to learn the relationships between them

  • This is analogous to adding vision capability to a LLM.

    

Generative AI Landscape / GPT series release date

• The Generative AI Revolution: Exploring the Current Landscape : doc [28 Jun 2023]

• Diffusion Models vs. GANs vs. VAEs: Comparison of Deep Generative Models [12 May 2023]

LLM Materials for East Asian Languages / Japanese

• AI事業者ガイドライン [Apr 2024]

LLM Materials for East Asian Languages / Korean

• Machine Learning Study 혼자 해보기 (⭐2.6k) [Sep 2018]

• LangChain 한국어 튜토리얼 (⭐922) [Feb 2024]

Agents: AutoGPT and Communicative Agents / Tool use: LLM to Master APIs

• Gorilla: An API store for LLMs: [cnt]: Gorilla: Large Language Model Connected with Massive APIs git (⭐11k) [24 May 2023]

  1. Used GPT-4 to generate a dataset of instruction-api pairs for fine-tuning Gorilla.

  2. Used the abstract syntax tree (AST) of the generated code to match with APIs in the database and test set for evaluation purposes.

  Another user asked how Gorilla compared to LangChain; Patil replied: LangChain is a terrific project that tries to teach agents how to use tools using prompting. Our take on this is that prompting is not scalable if you want to pick between 1000s of APIs. So Gorilla is a LLM that can pick and write the semantically and syntactically correct API for you to call! A drop in replacement into LangChain! cite [04 Jul 2023]

• Meta: Toolformer: [cnt]: Language Models That Can Use Tools, by MetaAI git (⭐1.9k) [9 Feb 2023]

• ToolLLM: [cnt]: : Facilitating Large Language Models to Master 16000+ Real-world APIs git (⭐4.7k) [31 Jul 2023]

Section 11: Datasets for LLM Training / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• MS MARCO Web Search (⭐301): A large-scale information-rich web dataset, featuring millions of real clicked query-document labels [Apr 2024]

Evaluating Large Language Models / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• Artificial Analysis LLM Performance Leaderboard: Performance benchmarks & pricing across API providers of LLMs

Evaluation metrics / Math

• Automated evaluation of LLMs

• n-gram based metrics: Evaluates the model using n-gram statistics and F1 score. ROUGE, BLEU, and METEOR are used for summarization and translation tasks.

• Probabilistic model evaluation metrics: Evaluates the model using the predictive performance of probability models. Perplexity.

• Embedding based metrics: Evaluates the model using semantic similarity of embeddings. Ada Similarity and BERTScore are used.

  Expand

  • ROUGE (Recall-Oriented Understudy for Gisting Evaluation): The metrics compare an automatically produced summary or translation against a reference or a set of references (human-produced) summary or translation. It includes several measures such as:

    1. ROUGE-N: Overlap of n-grams between the system and reference summaries.
    2. ROUGE-L: Longest Common Subsequence (LCS) based statistics.
    3. ROUGE-W: Weighted LCS-based statistics that favor consecutive LCSes.
    4. ROUGE-S: Skip-bigram based co-occurrence statistics.
    5. ROUGE-SU: Skip-bigram plus unigram-based co-occurrence statistics1.

  • n-gram: An n-gram is a contiguous sequence of n items from a given sample of text or speech. For example, in the sentence “I love AI”, the unigrams (1-gram) are “I”, “love”, “AI”; the bigrams (2-gram) are “I love”, “love AI”; and the trigram (3-gram) is “I love AI”.

  • BLEU: BLEU’s output is always a number between 0 and 1. An algorithm for evaluating the quality of machine-translated text. The closer a machine translation is to a professional human translation, the better it is.

  • BERTScore: A metric that leverages pre-trained contextual embeddings from BERT for text generation tasks. It combines precision and recall values.

  • Perplexity: A measure of a model's predictive performance, with lower values indicating better prediction.

  • METEOR: An n-gram based metric for machine translation, considering precision, recall, and semantic similarity.

• Human evaluation of LLMs (possibly Automate by LLM-based metrics): Evaluate the model’s performance on NLU and NLG tasks. It includes evaluations of relevance, fluency, coherence, and groundedness.

• Built-in evaluation methods in Prompt flow: ref [Aug 2023] / ref

50. Awesome Rust

Libraries / Data processing

• pg_lakehouse (⭐5.3k) - PostgreSQL extension that transforms Postgres into an analytical query engine over object stores like AWS S3/GCS and table formats like Delta Lake/Iceberg.

Applications / Audio and Music

• Pinepods (⭐184) - A rust based podcast management system with multi-user support. Pinepods utilizes a central database so aspects like listen time and themes follow from device to device. With clients built using Tauri, it's a full cross-platform listening solution!

Applications / Database

• lancedb (⭐3.9k) [vectordb] - A serverless, low-latency vector database for AI applications

Applications / Task scheduling

• tasklet (⭐24) [tasklet] - A task scheduling library written in Rust

Applications / Utilities

• Mobslide (⭐342) - Desktop application that turns your smartphone into presentation remote controller.

• Vibe (⭐619) - Transcribe audio or video in every language on every platform.

Libraries / Artificial Intelligence

• guillaume-be/rust-bert (⭐2.5k) [rust_bert] - Ready-to-use NLP pipelines and language models

Libraries / Computation

• faer-rs (⭐1.8k) [faer] - Linear algebra foundation for Rust

51. Awesome Angular

Community

• #angular hashtag on X.

• @Angular on X

X / Angular Team

• Minko Gechev

• Alan Agius

• Matthieu Riegler

• Alex Rickabaugh

• Kristiyan Kostadinov

• Paul Gschwendtner

• Joost Koehoorn

• Simona Cotin

• Emma Twersky

• Mark Thompson

• Pawel Kozlowski

• Dylan Hunn

X / Experts

• @PatrickJS__

• @pkozlowski_os

• @eggheadio

• @hirez_io

• @cedric_exbrayat

• @victorsavkin

• @jeffbcross

• @waterplea

• @marsibarsi

• @maciejtreder

• @maartentibau

X / Google Developer Experts

• Jack Franklin

• Thierry Chatel

• Uri Shaked

• Gonzalo Ruiz de Villa Suárez

• Sharon DiOrio

• John Papa

• Dan Wahlin

• Christian Weyer

• Todd Motto

• Tim Ruffles

• Wassim Chegham

• Aaron Frost

• Wilson Mendes

• Jared Williams

• Gerard Sans

• Pascal Precht

• Jeff Whelpley

• Raúl Jiménez

• Maxim Salnikov

• Deborah Kurata

• Shai Reznik

• Manfred Steyer

• Juri Strumpflohner

• William Grasel

• Alyssa Nicoll

• Nir kaufman

• Dmitriy Shekhovtsov

• Jeff Delaney

• Nishu Goel

• Alex Inkin

• Santosh Yadav

• Ankit

• Siddharth Ajmera

• Muhammad Ahsan Ayaz

• Dmytro Mezhenskyi

• Michael Hladky

• Fabio Biondi

• Thomas Laforge

• codewith_ahsan

Blogs / Google Developer Experts

• angular experts - Learn all about Angular, NgRx, RxJs & NX and advance your skills with guides, in-depth content and actionable tips and tricks!

• just angular - Shares the newest and most important updates about Angular, along with useful tips and tricks.

• angular minds

• angular architects

• Evgeniy Oz

CLI / Google Developer Experts

• angular-cli-diff (⭐328) - Easily upgrade your Angular CLI applications from one version to another 🚀.

• mantis-cli (⭐63) - M.A.N.T.I.S (MongoDB, Angular with Analog, Nx, Tailwind CSS, Ionic, Storybook) is not just a CLI tool; it's your passport to a seamless full-stack project launch.

Dates / Google Developer Experts

• ngx-date-fns (⭐163) - date-fns pipes for Angular.

• luxon-angular (⭐27) - date pipes for Angular.

• angular-globalize (⭐1) - Angular pipes for localizing numbers and dates using Globalize.

• ngx-mat-timepicker (⭐109) - A true material timepicker.

• angular-bootstrap-datetimepicker (⭐1.3k) - Native Angular date/time picker component styled by Bootstrap.

• ngx-datetime-range-picker (⭐25) - Angular material datetime range picker with daily, weekly, monthly, quarterly & yearly levels.

• mat-datetimepicker (⭐152) - Material datetimepicker for @angular/material.

• angular-datepicker (⭐495) - Highly configurable date picker built for Angular applications.

• ngx-daterangepicker-material (⭐248) - Pure Angular 2+ date range picker with material design theme.

• ngx-multiple-dates (⭐11) - Multiple dates picker based on Angular Material.

• ng-datetime (⭐0) - Angular library containing components used for handling datetime.

DOM / Google Developer Experts

• ngx-resize-observer (⭐17) - Angular 8+ module for detecting when elements are resized.

• ng-resize-observer (⭐22)

• ngx-mutation-observer (⭐5) - Get Angular 8+ events fired when an element is mutated in the DOM.

• ngx-visibility (⭐11) - Angular module that detects when elements are visible. Uses IntersectionObserver.

• ng-in-viewport (⭐224) - Allows us to check if an element is within the browsers visual viewport.

Layout Components / Google Developer Experts

• ngx-layout (⭐190) - Clone of Angular FlexLayout.

• ng-sortgrid (⭐144) - A grid that allows you to sort all items via drag & drop.

• angular-gridster2 (⭐1.3k) - Angular gridster 2.

• angular-grid-layout (⭐439) - Responsive grid with draggable and resizable items for Angular applications.

Mixed utilities / Google Developer Experts

• lithium-angular (⭐12) - Reactive components made easy! Lithium provides utilities that enable seamless reactive state and event interactions for Angular components.

Scroll / Google Developer Experts

• ngx-ui-scroll (⭐222) - Virtual/infinite scroll for Angular.

• ngx-page-scroll (⭐477) - Animated scrolling functionality for Angular written in pure TypeScript.

• lithium-ngx-virtual-scroll (⭐24) - A fast and lightweight virtual scrolling solution for Angular that supports single column lists, grid lists and view caching.

Tables / Google Developer Experts

• ui-grid (⭐5.4k) - UI Grid: an Angular Data Grid.

• jspreadsheet - Jspreadsheet is a lightweight vanilla javascript plugin to create amazing web-based online interactive tables and spreadsheets compatible with other spreadsheet software.

• handsontable - Handsontable is a popular JavaScript data grid component that brings the well-known look and feel of spreadsheets to your application.

Material Based / Google Developer Experts

• Angular Material - Material Design components for Angular.

RxJS / Google Developer Experts

• ngx-observable-lifecycle (⭐34) - Library for observing the lifecycle of an (ivy compiled) angular component.

• rx-sandbox (⭐172) - Marble diagram DSL based test suite for RxJS.

• observer-spy (⭐375) - This library makes RxJS Observables testing easy!

• ngx-operators (⭐136) - RxJS operators for Angular.

• rxjs-toolbox (⭐10) - Set of custom operators and handy factory functions for RxJS.

• subscribable-things (⭐42) - A collection of reactive wrappers for various browser APIs.

• ngx-rxjs-zone-scheduler (⭐32) - A library for Angular providing RxJS schedulers to run some kind of work inside or outside of NgZone.

• rxjs-broker (⭐24) - An RxJS message broker for WebRTC DataChannels and WebSockets.

• rxjs-insights (⭐359) - See through the observables.

52. Awesome Zsh Plugins

Plugins / superconsole - Windows-only

• brave (⭐0) - Manages Brave profiles. With this plugin, you can start the Brave Browser with a specific user profile by using the brave command followed by the profile's name. The plugin also implements autocompletion for the profile names so you won't have to type the entire profile name manually.

• explain-shell (brokentoaster) (⭐2) - Uses lynx to look up the current command line on explainshell.com.

• explain-shell (gmatheu) (⭐27) - Opens commands on explainshell.com.

• fixnumpad-osx (⭐3) - Enables numpad keys of Apple keyboards to be recognized in ZSH.

• fzf-plugin (atlas34) (⭐0) - oh-my-zsh (⭐172k)'s fzf plugin extracted so it can be used easily with other plugin managers.

• fzf-plugin (hwk929) (⭐0) - oh-my-zsh (⭐172k)'s fzf plugin extracted so it can be used easily with other plugin managers.

• git-status (⭐2) - Exposes functions with information about the current git repository.

• goenv (cda0) (⭐0) - Plugin for installing, updating and loading goenv.

• hist-delete (⭐0) - Delete history items from zsh's fzf (⭐63k) Ctrl+R history search.

• nobility (⭐3) - An organized colletion of shell modules designed to streamline your pentesting workflow by leveraging shell integrations such as autocompletion and prefilling, optimizing the productivity of your work and liberatating you from the hassle of juggling notes, endless copying and pasting, and tedious command editing.

• ollama (⭐11) - Integrates the OLLAMA AI model with fzf (⭐63k) to provide intelligent command suggestions based on user input requirements.

• raspberryPi4Temperature (⭐0) - Puts the Raspberry Pi temperature into a spaceship prompt segment

• ros2-env (⭐0) - Manage ROS 2 environment and workspaces.

Completions / superconsole - Windows-only

• tofu (⭐0) - Autoloads tab completions for tofu.

Themes / superconsole - Windows-only

• berghain (⭐1) - Minimalist theme. Includes decorators for the exit code of the last command run and for git status.

• candy-fantasy (⭐0) - Modified version of Candy Kingdowm (⭐172k)theme.

• cezhanne (⭐0) - Minimalist ZSH theme with git status decorators. Requires a Nerd Font.

• get-to-work (⭐1) - Minimalistic design, includes decorators for git status, virtual environment and the time.

• Prev: May 20 - May 26, 2024
• Next: May 06 - May 12, 2024