Awesome List Updates on Nov 06 - Nov 12, 2023

46 awesome lists updated this week.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Rust

Applications

• UpVPN (⭐173) - WireGuard VPN client for macOS, Linux, and Windows built on Tauri.

Applications / Package Managers

• helsing-ai/buffrs (⭐172) [buffrs] - A modern package manager for protocol buffers and gRPC architectures.

Applications / Routing protocols

• Holo (⭐248) - Holo is a suite of routing protocols designed to support high-scale and automation-driven networks

Libraries / Template engine

• Handlebars
  • sunng87/handlebars-rust (⭐1.2k) - Handlebars template engine with inheritance, custom helper support.
  • zzau13/yarte (⭐278) - Yarte stands for Yet Another Rust Template Engine, is the fastest template engine.

Resources / Web programming

• Watch Jon Gjengset Implement BitTorrent in Rust - Implementing (part of) a BitTorrent client in Rust

2. Awesome Django

Third-Party Packages / Templates

• curlylint - Experimental HTML templates linting for Jinja, Nunjucks, Django templates, Twig, Liquid.

• django-components (⭐1.1k) - A way to create simple reusable template components in Django.

• django-template-partials (⭐404) - Reusable named inline partials for the Django Template Language.

• djhtml (⭐569) - Django/Jinja template indenter.

• djlint - Lint & Format HTML Templates.

• slippers - Build reusable components in Django without writing a single line of Python.

• JinjaX - Super components powers for your Jinja templates.

Third-Party Packages / Testing

• storybook-django (⭐101) - Develop Django UI components in isolation, with Storybook.

Wagtail / Wagtail Resources

• Official website

• Developer documentation

• User documentation

• This week in Wagtail - A (most) weekly email with updates from the Wagtail core team.

3. Awesome Scientific Writing

Spell Checking and Linting

• proselint (⭐4.3k) - Linter for prose.

Tutorials / Books

• 3 frameworks into one — Write your next paper with R Studio! - Article provides an overview to a workflow that combines R Markdown (bookdown), Zotero (literature management), and Notion (note taking on research papers) to write academic papers.

• Heads up! Quarto is here to stay. Immediately combine R & Python in your next document - Summary of the capabilities of Quarto, why to use it, and how it compares to R Markdown. Also contains tips for M1 Mac users on how to fix a common problem with reticulate.

4. Awesome Shell

Shells

• murex (⭐1.3k) - A smarter shell and scripting environment with advanced features designed for usability, safety and productivity (eg smarter DevOps tooling)

Command-Line Productivity

• xiki (⭐3.8k) - Makes the shell console more friendly and powerful

Downloading and Serving / Directory Navigation

• yt-dlp (⭐66k) - Command-line program to download videos from YouTube.com and other video sites

Multimedia and File Formats / Directory Navigation

• library (⭐145) - Create SQLITE databases for folders of music, video, images, or online media. Play and track media like Plex but a CLI-only interface with many sorting options.

Shell Script Development / Directory Navigation

• Bash Hackers Wiki

5. Awesome Vue

Components & Libraries / UI Components

• vue-file-upload (⭐31) - A file management system that allows for single and multiple file uploading with a preview feature

Resources / Community

• [VueJS Bangladesh - Facebook Group] (https://www.facebook.com/groups/764064325433370)

Projects Using Vue.js / Open Source

• Al Quran App-Vue 3 - Al Quran App that allows you to read surah with english meaning

Projects Using Vue.js / Apps/Websites

• Portfolio Site - Monayem Islam, A full-stack web application developer's portfolio site. Made with Love and Vue 3.

Components & Libraries / UI Utilities

• vue-exit-intent (⭐17) - ✨ Vue Composable to handle user's Exit Intent.

6. Awesome Ada

News and Resources

• ada-europe - Ada-Europe is an international organization, set up to promote the use of Ada.

Misc / Apache License

• ada-chess (⭐7) - Chess engine written in Ada.

7. Awesome Nodejs

Packages / Command-line utilities

• terminal-size (⭐139) - Reliably get the terminal window size.

Packages / Image

• image-dimensions (⭐423) - Get the dimensions of an image.

Packages / Miscellaneous

• uint8array-extras (⭐209) - Useful utilities for working with Uint8Array and Buffer.

8. Static Analysis

Multiple languages / Other

• MOPSA — A static analyzer designed to easily reuse abstract domains across widely different languages (such as C and Python).

9. Awesome Testing

Software / Make your life easier

• Testomatio Modern TCMS allows sync of manual and automated tests in one place. Allure, TestRail, Xray alternative. FREE subscription forever is available.

10. Awesome Cybersecurity Blueteam

Security monitoring / Threat hunting

• Logging Made Easy (LME) - Free and open logging and protective monitoring solution serving.

11. Awesome Ipfs

Pinning services

• thirdweb - Easily upload and pin files to IPFS.

12. Awesome Lowcode

Flow-based programming

• IoTCatalyst - A Low Code/No Code IoT Edge Platform that offers IoT DevOps and IoT Device Management tools to make the IoT simpler.

13. Awesome Streaming

Table of Contents / Streaming Engine

• Pathway (⭐3.1k) [Python] - The fastest data processing engine supporting unified workflows for batch, streaming data, and LLM applications.

14. Awesome Cyber Security University

Free Beginner Red Team Path / Level 2 - Tooling

• Nmap,Curl and Netcat - Get experience with Nmap, Curl and Netcat for network communications.

Free Beginner Blue Team Path / Level 3 - Beginner Forensics, Threat Intel & Cryptography

• Intel101 Challenge - Medium level Threat Intel challenge.

15. Awesome Coq

Projects / User Interfaces

• VsCoq (⭐328) - Language server and extension for the Visual Studio Code and VSCodium editors.

• VsCoq Legacy (⭐328) - Backwards-compatible extension for the Visual Studio Code and VSCodium editors using Coq's legacy XML protocol.

Projects / Verified Software

• WasmCert-Coq (⭐89) - Formalization in Coq of the WebAssembly (aka Wasm) 1.0 specification.

Resources / Blogs

• MIT PLV blog posts on Coq

16. Awesome Falsehood

Internationalization

• Localization Failure: Temperature is Hard - You cannot localize temperature differences as-is.

Postal Addresses

• UK Address Oddities - Quirks extracted from a list of most residential property sales in England and Wales since 1995.

17. Awesome Azure Openai Llm

RAG Pipeline & Advanced RAG

• Advanced RAG Patterns: How to improve RAG peformance ref / ref [17 Oct 2023]
  1. Data quality: Clean, standardize, deduplicate, segment, annotate, augment, and update data to make it clear, consistent, and context-rich.
  2. Embeddings fine-tuning: Fine-tune embeddings to domain specifics, adjust them according to context, and refresh them periodically to capture evolving semantics.
  3. Retrieval optimization: Refine chunking, embed metadata, use query routing, multi-vector retrieval, re-ranking, hybrid search, recursive retrieval, query engine, HyDE [20 Dec 2022], and vector search algorithms to improve retrieval efficiency and relevance.
  4. Synthesis techniques: Query transformations, prompt templating, prompt conditioning, function calling, and fine-tuning the generator to refine the generation step.
  • HyDE: Implemented in LangChain: HypotheticalDocumentEmbedder (⭐91k). A query generates hypothetical documents, which are then embedded and retrieved to provide the most relevant results. query -> generate n hypothetical documents -> documents embedding - (avg of embeddings) -> retrieve -> final result. ref

Finetuning / Llama Finetuning

• Llama 2 ONNX git (⭐1k) [Jul 2023]

  • ONNX, or Open Neural Network Exchange, is an open standard for machine learning interoperability. It allows AI developers to use models across various frameworks, tools, runtimes, and compilers.

18. Awesome Ai Tools

Image / Services

• VectorArt.ai - Create vector images with AI.

Image / Image libraries

• Canva - Generating AI Images.

19. Awesome Polars

Resources / Blog posts

• Pandas2 and Polars for Feature Engineering - A blog post that A blog post that compares Pandas2 and Polars for Feature Engineering tasks with Python by @hopswork (⭐1.1k).

• Using Polars Plugins for a 14x Speed Boost with Rust - A blog post thats shows the use of Polars plugin system for Rust from some concrete examples by @ngriffiths13.

20. Awesome Executable Packing

📑 Datasets / Scientific Research

• The Malware Museum - The Malware Museum is a collection of malware programs, usually viruses, that were distributed in the 1980s and 1990s on home computers.

📦 Packers / After 2010

• Squishy - Modern packer developed for 64kb demoscene productions, targets 32bit and 64bit executables.

📦 Packers / Between 2000 and 2010

• CryptExec - Next-generation runtime binary encryption using on-demand function extraction.

📦 Packers / Before 2000

• Fire-Pack

• Pack-Ice

21. Awesome Java

Geospatial / Text-Based User Interfaces

• ArcGIS Maps SDK for Java (⭐111) - JavaFX library for adding mapping and GIS functionality to desktop apps.

Machine Learning / Text-Based User Interfaces

• Neureka (⭐68) - A lightweight, platform independent, OpenCL accelerated nd-array/tensor library.

22. Awesome Integration

Projects / ESB

• NServiceBus (⭐2k) (⭐2.1k) - A .NET-based service bus that offers an intuitive developer-friendly environment.

23. Awesome Nix

Development / Discovery

• Snowfall Lib (⭐365) - A library that makes it easy to manage your Nix flake by imposing an opinionated file structure.

24. Awesome Qubes OS

How-to guides

• How to resize dom0 - Just in case anyone needs help with this to resize dom0 from say 20G to 50G.

• How to open Urls in other qube - This page is about opening URLs and files from one qube in a different qube.

Templates

• archlinux-minimal template - This is a community guide, not an official guide.

• Building a TemplateVM for a new OS - If you don’t like using one of the existing templates because of specific administration, package management or other building needs, you can build a TemplateVM for your distribution of choice.

• NetBSD templates - Createa NetBSD template

• Linux HVMs - Fixing Linux distro HVMs

• Multimedia template - Configuring a “Multimedia” TemplateVM

• Windows Qubes - Like any other unmodified OSes, Windows can be installed in Qubes as an HVM domain.

• Tails OS - Tails stands for The Amnesic Incognito Live System. It is a live operating system that aims to preserve your privacy and anonymit.

• Shadow qube (⭐5) - The below script will create a Qube, launch the Tor browser, wait for the browser to close, then remove the qube and its RAM pool.

VM-Hardening

• Dom0 secure updates - Updating dom0

• nft Firewall - This is an example for a TCP redirection, for UDP you would have to replace tcp by udp.

• Signal - It uses end-to-end encryption to secure all communications.

• Split SSH - Split SSH implements a concept similar to having a smart card with your private SSH keys, except that the role of the “smart card” is played by another Qubes AppVM.

Customization

• DPI scaling - Qubes OS passes on dom0’s screen resolution to VMs (this can be seen in the output of xrandr) but doesn’t pass on dom0’s dpi value.

• PLayback performance - This guide will show you how to install the mpv player and use it with maximum performance.

• Wayland agent (⭐12) - This is a GUI agent for Qubes OS that supports the [Wayland] display server protocol. Compared to X11, Wayland is vastly simpler and aims to ensure every frame is perfect.

Troubleshooting

• Mounting a qube’s private storage in another qube - Useful for data recovery.

• Traffic Analysis in Qubes OS - You can place a ProxyVM between your AppVMs and Your NetVM. This way we can create an ideal topology for traffic analysis.

• Analyze Qubes OS VM (⭐1) - Analyze Qubes OS VM startup performance.

• Url redirector (⭐33) - This is a browser extension, aimed to improve surfing security.

• Changing your Time Zone - Change the system’s time zone in terminal you can issue the timedatectl command with the option set-timezone.

Clearnet & Anonymous Networking / Wireguard

• Mullvad VPN (Fedora38 + WG) - Privacy-first VPN provider's guide for Qubes OS. This guide bears an optimal method for setting up a WG ProxyVM (i.e sys-vpn); you may substitute out Mullvad's WG configuration files in place of your own.

• Wireguard setup - This guide assumes you are using a VPN service that has wireguard support.

Clearnet & Anonymous Networking / OpenVPN

• Mullvad VPN (Dedian 12 + OVPN) - Privacy-first VPN provider's guide for Qubes OS.

Clearnet & Anonymous Networking / Anonymity

• Really disposable ram based qubes - You can use your QubesOS 𝚜𝚝𝚊𝚝𝚎𝚕𝚎𝚜𝚜 just like TailsOS, with persistent storage for VMs. That is pretty simple! It takes 6Gb of extra 𝚁𝙰𝙼 (for store root filesystem files).

• How to bypass the GFW on Qubes OS when you’re in China - The purpose of this article is to provide several feasible ways to bypass the GFW for you to choose.

Exploitation Tools / Unikernel-like

• Hyperdbg (⭐2.7k) - HyperDbg Debugger is an open-source, community-driven, hypervisor-assisted, user-mode, and kernel-mode Windows debugger with a focus on using modern hardware technologies. It is a debugger designed for analyzing, fuzzing, and reversing.

Optics and Extra Info / Unikernel-like

• Hipervisor From Scratch (⭐2.1k)- Source code of a multiple series of tutorials about the hypervisor.

25. Urban and Regional Planning Resources

Vendor Data Resources / Travel Behavior

• AirSage - AirSage is a well-known provider of location based services and GPS data from cell phones operating in the space since 2000.

26. Awesome Selfhosted

Software / Document Management

• DocKing - Document management service/microservice that handles templates and renders them in PDF format, all in one place. (Demo, Source Code (⭐194)) MIT PHP/Nodejs/Docker

Software / Groupware

• Digistorm - Create collaborative surveys, quizzes, brainstorms, and word clouds (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs

Software / Learning and Courses

• Digiscreen - Interactive whiteboard/wallpaper for the classroom, in person or remotely (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs/PHP

Software / Miscellaneous

• Flyimg - Resize and crop images on the fly. Get optimised images with MozJPEG, WebP or PNG using ImageMagick, with an efficient caching system. (Demo, Source Code (⭐1k)) MIT Docker

Software / Self-hosting Solutions

• StartOS - Browser-based, graphical Operating System (OS) that makes running a personal server as easy as running a personal computer. (Source Code (⭐934)) MIT Rust

27. Free for Dev

APIs, Data, and ML

• OpenWeb Ninja - Extremely comprehensive real-time SERP and public data APIs: Google Search, Shopping, Jobs, Images, Lens, News, Google Maps Businesses / Places, Reviews, Photos, Website Emails and Social Contacts Scraper, Amazon, Yelp and more. All APIs include a free tier with 100 to 200 free monthly requests.

Design and UI

• Iconoir – An open-source icons library with thousands of icons, supporting React, React Native, Flutter, Vue, Figma, and Framer.

28. Awesome Vite

Templates / React

• vite-express-ssr-ts (⭐28) - React + Typescript + ExpressJS + Vite SSR template with inbuild api feature.

Framework-agnostic Plugins / Helpers

• vite-plugin-auto-origin (⭐3) - Detect origin configuration automatically based on incoming requests to dev server.

Vue / Loaders

• vite-plugin-markdown-mermaid (⭐4) - Load Markdown files, with Mermaid rendering support.

Svelte / Helpers

• vite-plugin-kit-routes (⭐392) - Generates a file with all the routes, params, actions of your SvelteKit App.

29. Awesome Neovim

Project / Diagnostics

• SalOrak/whaler.nvim (⭐57) - Telescope extension to move between directories blazingly fast.

Startup / Diagnostics

• TobinPalmer/Tip.nvim (⭐70) - Get a simple tip when you launch Neovim.

Motion / Diagnostics

• xiaoshihou514/squirrel.nvim (⭐13) - Quickly jump between tree-sitter nodes.

30. Awesome Zsh Plugins

Plugins / superconsole - Windows-only

• delete-prompt (⭐4) - ZSH widget to delete the prompt texts within the current line. It is useful when executing pasted commands from the web or a README. A leading non-alphanumeric character + space is detected as a prompt.

Completions / superconsole - Windows-only

• inshellisense (⭐8.3k) - Provides IDE style autocomplete for shells. It's a terminal native runtime for autocomplete which has support for 600+ command line tools. inshellisense supports bash, fish, zsh and pwsh on the Windows, Linux, & MacOS operating systems.

Themes / superconsole - Windows-only

• ludvig (⭐0) - Minimalist. Includes decorators for git status, current directory, current time and the last command's exit status.

31. Awesome Db Tools

IDE

• WebDB - Free Efficient Database IDE. Featuring Server Discovery, ERD, Data Generator, AI, NoSQL Structure Manager, Database Versioning and many more.

32. Awesome Wagtail

Open-source sites / Lists

• Penticon Public Library (⭐3) - An example public library website, originally created for the Penticton Public Library in Penticton, British Columbia, Canada.

33. Awesome Go

Template Engines

• templ (⭐7.8k) - A HTML templating language that has great developer tooling.

Code Analysis / Libraries for creating HTTP middlewares

• golangci-lint (⭐15k) – A fast Go linters runner. It runs linters in parallel, uses caching, supports yaml config, has integrations with all major IDE and has dozens of linters included.

• revive (⭐4.7k) – ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint.

• testifylint (⭐96) – A linter that checks usage of github.com/stretchr/testify (⭐23k).

Meetups / Libraries for creating HTTP middlewares

• Bärner Go Meetup - Berne, Switzerland

• Zürich Gophers - Zurich, Switzerland

34. Awesome Mac

Developer Tools / API Development and Analysis

• bruno - Bruno is a offline-only, fast and git-friendly opensource API client.

Developer Tools / Databases

• Studio 3T - the Ultimate GUI for MongoDB.

Communication / Email Clients

• CanaryMail - Secure email app for Mac and iPhone with built-in PGP Support and AI assitance.

35. Awesome Generative Deep Art

AI Engineering / Multi-agents

• An AI Engineer’s Guide to Machine Learning and Generative AI | by ai geek (wishesh) | Oct, 2023 | Medium

Generative AI history, timelines, maps, and definitions

• Emerging Trends in Generative AI Research: A Selection of Recent Papers

Large Language Models (LLMs)

• The architecture of today's LLM applications - The GitHub Blog

• How AI chatbots like ChatGPT or Bard work – visual explainer | The Guardian

• [🔥🔥] State of LLM Apps 2023 · Streamlit

• Demystifying LLMs: How they can do things they weren't trained to do - The GitHub Blog

Ethics, Philosophical questions and Discussions about Generative AI

• Recommendations for the advancement of artificial intelligence in Brazil – ABC [PT-BR]

• We must stop AI replicating the problems of surveillance capitalism

• Artificial Intelligence at the Service of Collective Intelligence

Running LLMs Locally / Prompt Engineering for Text-to-image

• [🔥🔥] Ollama: run Llama 2, Code Llama, and other models locally

Retrieval-Augmented Generation (RAG) / Prompt Engineering for Text-to-image

• imartinez/privateGPT (⭐53k): "Interact with your documents using the power of GPT, 100% privately, no data leaks"

• pinecone-io/canopy (⭐935): Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

• Forget RAG, the Future is RAG-Fusion: post by Adrian H. Raudaschl in Towards Data Science

LLM Evaluation / Multi-agents

• LLM Comparison/Test: 39 models tested (7B-70B + ChatGPT/GPT-4)

Image Segmentation / Deforum

• AILab-CVC/VideoCrafter (⭐4.4k): Open Diffusion Models for High-Quality Video Generation

• What's Generative Music? - Generative Music AI - YouTube

Inbox: Speech-to-text (STT) and spoken content analysis / Deforum

• Vaibhavs10/insanely-fast-whisper (⭐7.1k): accelerates transcription with the combination of OpenAI's Whisper Large v2, HF Transformers, Optimum, and flash attention

• deepseek-ai/DeepSeek-Coder (⭐6.3k): a tool that experiments the motto "let the code write itself"

• NExT-Chat: An LMM for Chat, Detection and Segmentation

• roboflow/awesome-openai-vision-api-experiments (⭐1.6k): Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams

36. Awesome Transit

Web Apps (open source)

• Dede - An independent and universal passenger information system (PIS) mapping realtime movement. A message feed with Vehicle Position entities in the GTFS-Realtime format or the Dede app (⭐1) can be used as data source.

GTFS Libraries / Python

• gtfs_functions (⭐105) - Python package with useful functions to create geo-spatial visualizations from GTFS feeds.

37. Awesome Product Management

Articles / Obsidian

• Don't Give Your Users Shit Work - By Zach Holman.

• Mud Rooms, Red Letters, and Real Priorities - By Merlin Mann.

38. Awesome Agi Cocosci

Concepts / AI Concept Representation

• A principal odor map unifies diverse tasks in olfactory perception - Science, 2023. [All Versions]. [Code (⭐20)]. [Data (Reproduced)]. [Preprint]. [GoodScents Database]. [Leffingwell Database]. A Principal Odor Map (POM) that preserves perceptual relationships and enables odor quality prediction for novel odorants.

• Connecting Touch and Vision via Cross-Modal Prediction - CVPR'19, 2019. [All Versions]. [Project (⭐67)].

39. Awesome Cpp

Audio

• Amplitude Audio SDK (⭐28) - A cross-platform audio engine designed with the needs of games in mind. [Apache-2.0] website

Font

• libschrift (⭐457) - A lightweight TrueType font rendering library. [ISC]

Graphics

• ThorVG (⭐647) - a platform-independent portable library that allows for drawing vector-based scenes and animations, including SVG and Lottie. [MIT] website

Networking

• nghttp3 (⭐844) - HTTP/3 library written in C. [MIT] website

40. Awesome Fuzzing

Tools / File

• AFL++ (⭐4.1k) - AFL++ is a superior fork to Google's AFL - more speed, more and better mutations, more and better instrumentation, custom module support, etc.

• Angora (⭐882) - Angora is a mutation-based coverage guided fuzzer. The main goal of Angora is to increase branch coverage by solving path constraints without symbolic execution.

41. Awesome Cl

Graph databases

• neo4cl - a library for interacting with Neo4J. Sends Cypher queries to a Neo4J server, and decodes the responses into something useful for processing in CL. Apache2.
  • and maybe: cl-neo4j (⭐26) - a thin neo4j RESTFUL client interface.

Iteration

• cl-transducers - Ergonomic, efficient data processing. LGPL3.
  • "Transducers are an ergonomic and extremely memory-efficient way to process a data source. Here “data source” means simple collections like Lists or Vectors, but also potentially large files or generators of infinite data."
  • "It is, in general, the most complete implementation of the Transducer pattern."
  • a "modern" API with map, filter, take, repeat, cycle, fold…

42. Awesome Npm

Other

• package-up (⭐148) - Find the closest package.json file.

• read-package-up (⭐250) - Read the closest package.json file.

• package-config (⭐113) - Get namespaced config from the closest package.json.

43. Awesome Typescript

Back-end API / Playground

• 🐙 Fastify (⭐32k) - Fast and low overhead web framework, for Node.js

• 🐙 Hono - Hono is a small, simple, and ultrafast web framework for the Edges. It works on any JavaScript runtime

Libraries / Chrome Extensions

• 🐙 SuperJSON (⭐3.9k) - Safely serialize JavaScript expressions to a superset of JSON, which includes Dates, BigInts, and more

44. Web Development Resources

Hosting:

• Website: https://fleek.co/

  Description: Fleek makes it easy to build websites and apps on the new open web: permissionless, trustless, censorship resistant, and free of centralized gatekeepers.

Coding Challenge Platforms:

• Website: https://dapp-world.com/problems

45. Free Programming Books (English, By Subjects)

Mathematics

• Guide to Discrete Mathematics - David Gries, Fred B. Schneider (PDF)

46. Awesome Terraform

Tools / Community providers

• tfprovidercheck (⭐70) - CLI to prevent malicious Terraform Providers from being executed

• Prev: Nov 13 - Nov 19, 2023
• Next: Oct 30 - Nov 05, 2023