Search Results for "architectural design"

ModernBERT is an open-source research project that modernizes the classic BERT encoder architecture by incorporating recent advances in transformer design, training techniques, and efficiency improvements. The goal of the project is to bring BERT-style models up to date with the capabilities of modern large language models while preserving the strengths of bidirectional encoder architectures used for tasks such as classification, retrieval, and semantic search. ModernBERT introduces architectural improvements that enhance both training efficiency and inference performance, making the model more suitable for modern large-scale machine learning pipelines. ...

...Introduced in the ICML 2024 paper “MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases”, it focuses on delivering strong reasoning and generalization capabilities in models under one billion parameters. The framework integrates several architectural innovations—SwiGLU activation, deep and thin network design, embedding sharing, and grouped-query attention (GQA)—to achieve a superior trade-off between model size, inference speed, and accuracy. MobileLLM demonstrates remarkable performance, with the 125M and 350M variants outperforming previous state-of-the-art models of the same scale by up to 4.3% on zero-shot commonsense reasoning tasks.

...When it comes to building HTTP APIs, other frameworks weigh you down with tons of dependencies and unnecessary abstractions. Falcon cuts to the chase with a clean design that embraces HTTP and the REST architectural style. Highly optimized, extensible code base. Easy access to headers and bodies through request and response objects. DRY request processing via middleware components and hooks. Strict adherence to RFCs. Idiomatic HTTP error responses. Straightforward exception handling. Snappy testing with WSGI/ASGI helpers and mocks. ...

Build Your Own OpenClaw is a step-by-step educational framework that teaches developers how to construct a fully functional AI agent system from scratch, gradually evolving from a simple chat loop into a multi-agent, production-ready architecture. The project is structured into 18 progressive stages, each introducing a new concept such as tool usage, memory persistence, event-driven design, and multi-agent coordination, with each step including both explanatory documentation and runnable code. It begins with foundational concepts like conversational loops and tool integration, then expands into more advanced capabilities such as dynamic skill loading, web interaction, and context management. As the tutorial progresses, it introduces architectural improvements including event-driven systems, WebSocket communication, and configuration hot-reloading to support scalability and real-time interaction.

DAE Tools is a cross-platform equation-based object-oriented modelling, simulation and optimisation software. It is not a modelling language nor a collection of numerical libraries but rather a higher level structure – an architectural design of interdependent software components providing an API for: - Model development/specification - Activities on developed models, such as simulation, optimisation, sensitivity analysis and parameter estimation - Processing of the results, such as plotting and exporting to various file formats - Report generation - Code generation, co-simulation and model exchange The following class of problems can be solved by DAE Tools: - Initial value problems of implicit form - Index-1 DAE systems - With lumped or distributed parameters - Steady-state or dynamic - Continuous with some elements of event-driven systems

...The repository is particularly useful for engineers who want to move beyond model usage and understand the systems engineering layer that enables large-scale machine learning. Its content emphasizes architectural thinking, performance considerations, and the relationship between hardware acceleration and deep learning frameworks.

...This objective sidesteps generative pixel losses and avoids heavy negative sampling, producing features that transfer strongly with linear probes and minimal fine-tuning. The design scales naturally with Vision Transformer backbones and flexible masking strategies, and it trains stably at large batch sizes. i-JEPA’s predictions are made in embedding space, which is computationally efficient and better aligned with downstream discrimination tasks. The repository provides training recipes, data pipelines, and evaluation code that clarify which masking patterns and architectural choices matter most.

Buildes is an integrated development environment that assists the user in creating building information. It reads a text (session) file from which it compiles the information. It then allows the user to browse, analyze and export the resulting building knowledge. The compilation system is written in pure Python. The building components created are rendered in PythonOCC. The GUI is written using PyQt.

Why do Archicad and Revit only share 30 or 40% of the global architectural sofware market ? Maybe because lots of small practices find these software unadapted to the way they work, and to their bank account. I think there's place for an open software that doesn't work like the existing. It will be simple in its tools and processes, and will have infinite capabilities. This will be possible by defining a logical structure. As I am an architect, and I know very little about programming,...

Lightweight and flexible rendering system used as an educational, expermental or quick-start platform for developing real-time 3D rendering applications, particularly games, technology demos, intuitive real-time architectural/interior design tools etc.