Awesome List Updates on Nov 06 - Nov 12, 2023

43 awesome lists updated this week.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Rust

Applications

• UpVPN (⭐237) - WireGuard VPN client for macOS, Linux, and Windows built on Tauri.

Applications / Package Managers

• helsing-ai/buffrs (⭐230) [buffrs] - A modern package manager for protocol buffers and gRPC architectures.

Applications / Routing protocols

• Holo (⭐295) - Holo is a suite of routing protocols designed to support high-scale and automation-driven networks

Libraries / Template engine

• Handlebars
  • sunng87/handlebars-rust (⭐1.3k) - Handlebars template engine with inheritance, custom helper support.
  • zzau13/yarte (⭐280) - Yarte stands for Yet Another Rust Template Engine, is the fastest template engine.

Resources / Web programming

• Watch Jon Gjengset Implement BitTorrent in Rust - Implementing (part of) a BitTorrent client in Rust

2. Awesome Django

Third-Party Packages / Templates

• curlylint - Experimental HTML templates linting for Jinja, Nunjucks, Django templates, Twig, Liquid.

• django-components (⭐1.2k) - A way to create simple reusable template components in Django.

• django-template-partials (⭐505) - Reusable named inline partials for the Django Template Language.

• djhtml (⭐586) - Django/Jinja template indenter.

• djlint - Lint & Format HTML Templates.

• slippers - Build reusable components in Django without writing a single line of Python.

• JinjaX - Super components powers for your Jinja templates.

Third-Party Packages / Testing

• storybook-django (⭐109) - Develop Django UI components in isolation, with Storybook.

Wagtail / Wagtail Resources

• Official website

• Developer documentation

• User documentation

• This week in Wagtail - A (most) weekly email with updates from the Wagtail core team.

3. Awesome Scientific Writing

Spell Checking and Linting

• proselint (⭐4.3k) - Linter for prose.

Tutorials / Books

• 3 frameworks into one — Write your next paper with R Studio! - Article provides an overview to a workflow that combines R Markdown (bookdown), Zotero (literature management), and Notion (note taking on research papers) to write academic papers.

• Heads up! Quarto is here to stay. Immediately combine R & Python in your next document - Summary of the capabilities of Quarto, why to use it, and how it compares to R Markdown. Also contains tips for M1 Mac users on how to fix a common problem with reticulate.

4. Awesome Shell

Shells

• murex (⭐1.3k) - A smarter shell and scripting environment with advanced features designed for usability, safety and productivity (eg smarter DevOps tooling)

Command-Line Productivity

• xiki (⭐3.8k) - Makes the shell console more friendly and powerful

Downloading and Serving / Directory Navigation

• yt-dlp (⭐66k) - Command-line program to download videos from YouTube.com and other video sites

Multimedia and File Formats / Directory Navigation

• library (⭐145) - Create SQLITE databases for folders of music, video, images, or online media. Play and track media like Plex but a CLI-only interface with many sorting options.

Shell Script Development / Directory Navigation

• Bash Hackers Wiki

5. Awesome Vue

Projects Using Vue.js / Apps/Websites

• Portfolio Site - Monayem Islam, A full-stack web application developer's portfolio site. Made with Love and Vue 3.

Components & Libraries / UI Utilities

• vue-exit-intent (⭐21) - ✨ Vue Composable to handle user's Exit Intent.

6. Awesome Ada

News and Resources

• ada-europe - Ada-Europe is an international organization, set up to promote the use of Ada.

Misc / Apache License

• ada-chess (⭐8) - Chess engine written in Ada.

7. Awesome Nodejs

Packages / Command-line utilities

• terminal-size (⭐140) - Reliably get the terminal window size.

Packages / Image

• image-dimensions (⭐435) - Get the dimensions of an image.

Packages / Miscellaneous

• uint8array-extras (⭐214) - Useful utilities for working with Uint8Array and Buffer.

8. Static Analysis

Multiple languages / Other

• MOPSA — A static analyzer designed to easily reuse abstract domains across widely different languages (such as C and Python).

9. Awesome Testing

Software / Make your life easier

• Testomatio Modern TCMS allows sync of manual and automated tests in one place. Allure, TestRail, Xray alternative. FREE subscription forever is available.

10. Awesome Cybersecurity Blueteam

Security monitoring / Threat hunting

• Logging Made Easy (LME) - Free and open logging and protective monitoring solution serving.

11. Awesome Lowcode

Flow-based programming

• IoTCatalyst - A Low Code/No Code IoT Edge Platform that offers IoT DevOps and IoT Device Management tools to make the IoT simpler.

12. Awesome Streaming

Table of Contents / Streaming Engine

• Pathway (⭐10k) [Python] - The fastest data processing engine supporting unified workflows for batch, streaming data, and LLM applications.

13. Awesome Cyber Security University

Free Beginner Red Team Path / Level 2 - Tooling

• Nmap,Curl and Netcat - Get experience with Nmap, Curl and Netcat for network communications.

Free Beginner Blue Team Path / Level 3 - Beginner Forensics, Threat Intel & Cryptography

• Intel101 Challenge - Medium level Threat Intel challenge.

14. Awesome Coq

Projects / User Interfaces

• VsCoq (⭐355) - Language server and extension for the Visual Studio Code and VSCodium editors.

• VsCoq Legacy (⭐355) - Backwards-compatible extension for the Visual Studio Code and VSCodium editors using Coq's legacy XML protocol.

Projects / Verified Software

• WasmCert-Coq (⭐101) - Formalization in Coq of the WebAssembly (aka Wasm) 1.0 specification.

Resources / Blogs

• MIT PLV blog posts on Coq

15. Awesome Falsehood

Internationalization

• Localization Failure: Temperature is Hard - You cannot localize temperature differences as-is.

Postal Addresses

• UK Address Oddities - Quirks extracted from a list of most residential property sales in England and Wales since 1995.

16. Awesome Ai Tools

Image / Services

• VectorArt.ai - Create vector images with AI.

Image / Image libraries

• Canva - Generating AI Images.

17. Awesome Polars

Resources / Blog posts

• Pandas2 and Polars for Feature Engineering - A blog post that A blog post that compares Pandas2 and Polars for Feature Engineering tasks with Python by @hopswork (⭐1.2k).

• Using Polars Plugins for a 14x Speed Boost with Rust - A blog post thats shows the use of Polars plugin system for Rust from some concrete examples by @ngriffiths13.

18. Awesome Executable Packing

📑 Datasets / Scientific Research

• The Malware Museum - The Malware Museum is a collection of malware programs, usually viruses, that were distributed in the 1980s and 1990s on home computers.

📦 Packers / After 2010

• Squishy - Modern packer developed for 64kb demoscene productions, targets 32bit and 64bit executables.

📦 Packers / Between 2000 and 2010

• CryptExec - Next-generation runtime binary encryption using on-demand function extraction.

📦 Packers / Before 2000

• Fire-Pack

• Pack-Ice

19. Awesome Java

Geospatial / Text-Based User Interfaces

• ArcGIS Maps SDK for Java (⭐113) - JavaFX library for adding mapping and GIS functionality to desktop apps.

Machine Learning / Text-Based User Interfaces

• Neureka (⭐70) - A lightweight, platform independent, OpenCL accelerated nd-array/tensor library.

20. Awesome Nix

Development / Discovery

• Snowfall Lib (⭐456) - A library that makes it easy to manage your Nix flake by imposing an opinionated file structure.

21. Awesome Qubes OS

How-to guides

• How to resize dom0 - Just in case anyone needs help with this to resize dom0 from 20G to 50G.

• How to open Urls in other qube - This page is about opening URLs and files from one qube in a different qube.

Templates

• archlinux-minimal template - This is a community guide, not an official guide.

• Building a TemplateVM for a new OS - If you don’t like using one of the existing templates because of specific administration, package management or other building needs, you can build a TemplateVM for your distribution of choice.

• NetBSD templates - Createa NetBSD template

• Linux HVMs - Fixing Linux distro HVMs

• Multimedia template - Configuring a “Multimedia” TemplateVM

• Windows Qubes - Like any other unmodified OSes, Windows can be installed in Qubes as an HVM domain.

• Tails OS - Tails stands for The Amnesic Incognito Live System. It is a live operating system that aims to preserve your privacy and anonymit.

• Shadow qube (⭐7) - The below script will create a Qube, launch the Tor browser, wait for the browser to close, then remove the qube and its RAM pool.

VM-Hardening

• Dom0 secure updates - Updating dom0

• nft Firewall - This is an example for a TCP redirection, for UDP you would have to replace tcp by udp.

• Signal - It uses end-to-end encryption to secure all communications.

• Split SSH - Split SSH implements a concept similar to having a smart card with your private SSH keys, except that the role of the “smart card” is played by another Qubes AppVM.

Customization

• DPI scaling - Qubes OS passes on dom0’s screen resolution to VMs (this can be seen in the output of xrandr) but doesn’t pass on dom0’s dpi value.

• Wayland agent (⭐16) - This is a GUI agent for Qubes OS that supports the [Wayland] display server protocol. Compared to X11, Wayland is vastly simpler and aims to ensure every frame is perfect.

Troubleshooting

• Mounting a qube’s private storage in another qube - Useful for data recovery.

• Traffic Analysis in Qubes OS - You can place a ProxyVM between your AppVMs and Your NetVM. This way we can create an ideal topology for traffic analysis.

• Analyze Qubes OS VM (⭐1) - Analyze Qubes OS VM startup performance.

• Url redirector (⭐35) - This is a browser extension, aimed to improve surfing security.

• Changing your Time Zone - Change the system’s time zone in terminal you can issue the timedatectl command with the option set-timezone.

Clearnet & Anonymous Networking / Wireguard

• Mullvad VPN (Fedora38 + WG) - Privacy-first VPN provider's guide for Qubes OS. This guide bears an optimal method for setting up a WG ProxyVM (i.e sys-vpn); you may substitute out Mullvad's WG configuration files in place of your own.

• Wireguard setup - This guide assumes you are using a VPN service that has wireguard support.

Clearnet & Anonymous Networking / OpenVPN

• Mullvad VPN (Dedian 12 + OVPN) - Privacy-first VPN provider's guide for Qubes OS.

Clearnet & Anonymous Networking / Anonymity

• Really disposable ram based qubes - You can use your QubesOS 𝚜𝚝𝚊𝚝𝚎𝚕𝚎𝚜𝚜 just like TailsOS, with persistent storage for VMs. That is pretty simple! It takes 6Gb of extra 𝚁𝙰𝙼 (for store root filesystem files).

• How to bypass the GFW on Qubes OS when you’re in China - The purpose of this article is to provide several feasible ways to bypass the GFW for you to choose.

Exploitation Tools / Unikernel-like

• Hyperdbg (⭐2.9k) - HyperDbg Debugger is an open-source, community-driven, hypervisor-assisted, user-mode, and kernel-mode Windows debugger with a focus on using modern hardware technologies. It is a debugger designed for analyzing, fuzzing, and reversing.

Optics and Extra Info / Extra Info

• Hipervisor From Scratch (⭐2.2k)- Source code of a multiple series of tutorials about the hypervisor.

22. Urban and Regional Planning Resources

Vendor Data Resources / Travel Behavior

• AirSage - AirSage is a well-known provider of location based services and GPS data from cell phones operating in the space since 2000.

23. Awesome Selfhosted

Software / Document Management

• DocKing - Document management service/microservice that handles templates and renders them in PDF format, all in one place. (Demo, Source Code (⭐235)) MIT PHP/Nodejs/Docker

Software / Groupware

• Digistorm - Create collaborative surveys, quizzes, brainstorms, and word clouds (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs

Software / Learning and Courses

• Digiscreen - Interactive whiteboard/wallpaper for the classroom, in person or remotely (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs/PHP

Software / Miscellaneous

• Flyimg - Resize and crop images on the fly. Get optimised images with MozJPEG, WebP or PNG using ImageMagick, with an efficient caching system. (Demo, Source Code (⭐1.1k)) MIT Docker

Software / Self-hosting Solutions

• StartOS - Browser-based, graphical Operating System (OS) that makes running a personal server as easy as running a personal computer. (Source Code (⭐1.1k)) MIT Rust

24. Free for Dev

APIs, Data, and ML

• OpenWeb Ninja - Extremely comprehensive real-time SERP and public data APIs: Google Search, Shopping, Jobs, Images, Lens, News, Google Maps Businesses / Places, Reviews, Photos, Website Emails and Social Contacts Scraper, Amazon, Yelp and more. All APIs include a free tier with 100 to 200 free monthly requests.

Design and UI

• Iconoir – An open-source icons library with thousands of icons, supporting React, React Native, Flutter, Vue, Figma, and Framer.

25. Awesome Vite

Templates / Vue 3

• vue-file-upload (⭐32) - A file management system built with Vue3 and TypeScript that allows for single and multiple file uploading with a preview feature.

Templates / React

• vite-express-ssr-ts (⭐43) - React + Typescript + ExpressJS + Vite SSR template with inbuild api feature.

Framework-agnostic Plugins / Helpers

• vite-plugin-auto-origin (⭐3) - Detect origin configuration automatically based on incoming requests to dev server.

Vue / Loaders

• vite-plugin-markdown-mermaid (⭐4) - Load Markdown files, with Mermaid rendering support.

Svelte / Helpers

• vite-plugin-kit-routes (⭐417) - Generates a file with all the routes, params, actions of your SvelteKit App.

26. Awesome Neovim

Project / Diagnostics

• SalOrak/whaler.nvim (⭐58) - Telescope extension to move between directories blazingly fast.

Startup / Diagnostics

• TobinPalmer/Tip.nvim (⭐76) - Get a simple tip when you launch Neovim.

Motion / Diagnostics

• xiaoshihou514/squirrel.nvim (⭐15) - Quickly jump between Tree-sitter nodes.

27. Awesome Zsh Plugins

Plugins / superconsole - Windows-only

• delete-prompt (⭐4) - ZSH widget to delete the prompt texts within the current line. It is useful when executing pasted commands from the web or a README. A leading non-alphanumeric character + space is detected as a prompt.

Completions / superconsole - Windows-only

• inshellisense (⭐9.1k) - Provides IDE style autocomplete for shells. It's a terminal native runtime for autocomplete which has support for 600+ command line tools. inshellisense supports bash, fish, zsh and pwsh on the Windows, Linux, & MacOS operating systems.

Themes / superconsole - Windows-only

• ludvig (⭐0) - Minimalist. Includes decorators for git status, current directory, current time and the last command's exit status.

28. Awesome Db Tools

IDE

• WebDB - Free Efficient Database IDE. Featuring Server Discovery, ERD, Data Generator, AI, NoSQL Structure Manager, Database Versioning and many more.

29. Awesome Wagtail

Open-source sites / Lists

• Penticon Public Library (⭐4) - An example public library website, originally created for the Penticton Public Library in Penticton, British Columbia, Canada.

30. Awesome Go

Template Engines

• templ (⭐8.7k) - A HTML templating language that has great developer tooling.

Code Analysis / Libraries for creating HTTP middlewares

• golangci-lint (⭐16k) – A fast Go linters runner. It runs linters in parallel, uses caching, supports yaml config, has integrations with all major IDE and has dozens of linters included.

• revive (⭐4.9k) – ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint.

• testifylint (⭐115) – A linter that checks usage of github.com/stretchr/testify (⭐24k).

Meetups / Libraries for creating HTTP middlewares

• Bärner Go Meetup - Berne, Switzerland

• Zürich Gophers - Zurich, Switzerland

31. Awesome Mac

Developer Tools / API Development and Analysis

• bruno - Bruno is a offline-only, fast and git-friendly opensource API client.

Developer Tools / Databases

• Studio 3T - the Ultimate GUI for MongoDB.

Communication / Email Clients

• CanaryMail - Secure email app for Mac and iPhone with built-in PGP Support and AI assistance.

32. Awesome Generative Deep Art

AI Engineering / Multi-agents

• An AI Engineer’s Guide to Machine Learning and Generative AI | by ai geek (wishesh) | Oct, 2023 | Medium

Generative AI history, timelines, maps, and definitions

• Emerging Trends in Generative AI Research: A Selection of Recent Papers

Large Language Models (LLMs)

• The architecture of today's LLM applications - The GitHub Blog

• How AI chatbots like ChatGPT or Bard work – visual explainer | The Guardian

• [🔥🔥] State of LLM Apps 2023 · Streamlit

• Demystifying LLMs: How they can do things they weren't trained to do - The GitHub Blog

Ethics, Philosophical questions and Discussions about Generative AI

• Recommendations for the advancement of artificial intelligence in Brazil – ABC [PT-BR]

• We must stop AI replicating the problems of surveillance capitalism

• Artificial Intelligence at the Service of Collective Intelligence

Running LLMs Locally / Prompt Engineering for Text-to-image

• [🔥🔥] Ollama: run Llama 2, Code Llama, and other models locally

Retrieval-Augmented Generation (RAG) / Prompt Engineering for Text-to-image

• imartinez/privateGPT (⭐55k): "Interact with your documents using the power of GPT, 100% privately, no data leaks"

• pinecone-io/canopy (⭐994): Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

• Forget RAG, the Future is RAG-Fusion: post by Adrian H. Raudaschl in Towards Data Science

LLM Evaluation / Multi-agents

• LLM Comparison/Test: 39 models tested (7B-70B + ChatGPT/GPT-4)

Image Segmentation / Deforum

• AILab-CVC/VideoCrafter (⭐4.7k): Open Diffusion Models for High-Quality Video Generation

• What's Generative Music? - Generative Music AI - YouTube

Speech-to-text (STT) and spoken content analysis / Deforum

• Vaibhavs10/insanely-fast-whisper (⭐8k): accelerates transcription with the combination of OpenAI's Whisper Large v2, HF Transformers, Optimum, and flash attention

• deepseek-ai/DeepSeek-Coder (⭐10k): a tool that experiments the motto "let the code write itself"

• NExT-Chat: An LMM for Chat, Detection and Segmentation

• roboflow/awesome-openai-vision-api-experiments (⭐1.7k): Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams

33. Awesome Transit

Web Apps (open source)

• Dede - An independent and universal passenger information system (PIS) mapping realtime movement. A message feed with Vehicle Position entities in the GTFS-Realtime format or the Dede app can be used as data source.

GTFS Libraries / Python

• gtfs_functions (⭐117) - Python package with useful functions to create geo-spatial visualizations from GTFS feeds.

34. Awesome Product Management

Articles / Obsidian

• Don't Give Your Users Shit Work - By Zach Holman.

• Mud Rooms, Red Letters, and Real Priorities - By Merlin Mann.

35. Awesome Agi Cocosci

Concepts / AI Concept Representation

• A principal odor map unifies diverse tasks in olfactory perception - Science, 2023. [All Versions]. [Code (⭐24)]. [Data (Reproduced)]. [Preprint]. [GoodScents Database]. [Leffingwell Database]. A Principal Odor Map (POM) that preserves perceptual relationships and enables odor quality prediction for novel odorants.

• Connecting Touch and Vision via Cross-Modal Prediction - CVPR'19, 2019. [All Versions]. [Project (⭐72)].

36. Awesome Cpp

Audio

• Amplitude Audio SDK (⭐41) - A cross-platform audio engine designed with the needs of games in mind. [Apache-2.0] website

Font

• libschrift (⭐492) - A lightweight TrueType font rendering library. [ISC]

Graphics

• ThorVG (⭐830) - a platform-independent portable library that allows for drawing vector-based scenes and animations, including SVG and Lottie. [MIT] website

Networking

• nghttp3 (⭐889) - HTTP/3 library written in C. [MIT] website

37. Awesome Fuzzing

Tools / File

• AFL++ (⭐4.1k) - AFL++ is a superior fork to Google's AFL - more speed, more and better mutations, more and better instrumentation, custom module support, etc.

• Angora (⭐882) - Angora is a mutation-based coverage guided fuzzer. The main goal of Angora is to increase branch coverage by solving path constraints without symbolic execution.

38. Awesome Cl

Graph databases

• neo4cl - a library for interacting with Neo4J. Sends Cypher queries to a Neo4J server, and decodes the responses into something useful for processing in CL. Apache2.
  • and maybe: cl-neo4j (⭐26) - a thin neo4j RESTFUL client interface.

39. Awesome Npm

Other

• package-up (⭐159) - Find the closest package.json file.

• read-package-up (⭐258) - Read the closest package.json file.

• package-config (⭐120) - Get namespaced config from the closest package.json.

40. Awesome Typescript

Back-end API / Playground

• 🐙 Fastify (⭐33k) - Fast and low overhead web framework, for Node.js

• 🐙 Hono - Hono is a small, simple, and ultrafast web framework for the Edges. It works on any JavaScript runtime

Libraries / Chrome Extensions

• 🐙 SuperJSON (⭐4.3k) - Safely serialize JavaScript expressions to a superset of JSON, which includes Dates, BigInts, and more

41. Web Development Resources

Hosting:

• Website: https://fleek.co/

  Description: Fleek makes it easy to build websites and apps on the new open web: permissionless, trustless, censorship resistant, and free of centralized gatekeepers.

Coding Challenge Platforms:

• Website: https://dapp-world.com/problems

42. Free Programming Books (English, By Subjects)

Mathematics

• Guide to Discrete Mathematics - David Gries, Fred B. Schneider (PDF)

43. Awesome Terraform

Tools / Community providers

• tfprovidercheck (⭐77) - CLI to prevent malicious Terraform Providers from being executed

• Prev: Nov 13 - Nov 19, 2023
• Next: Oct 30 - Nov 05, 2023