On a daily basis, I deal with custom software development and take part in projects for various industries. I specialize in the use of Modern C++ in embedded systems and building applications using Qt. Here, I will share with you my experience in a project that required Protocol Buffers on a memory-constrained embedded system. Let’s … Read more
I’m not quite sure how to ask this question, but I need some clarification on how to make use of Dask’s ability to “handle datasets that don’t fit into memory”, because I’m a little confused on how it works from the CREATION of these datasets. I have made a reproducible code below that closely emulates … Read more
Articles To Read Before We Start I’ve already written articles about memory estimation. The first one explains how to calculate memory for objects, arrays, etc. The second one shows tools for how to estimate recursively any object size. Before you begin this article, I strongly recommend you read the first ones. Otherwise, it would be … Read more
Note: This is the first of a five-part series covering Kubernetes resource management and optimization. We start by describing Kubernetes resource types. Before we dive into Kubernetes resources, let’s clarify what the term “resource” refers to here. Anything we create in a Kubernetes cluster is considered a resource: deployments, pods, services, and more. For this … Read more
JVM is a monster – in a good way. Its architecture and especially the super-optimized just-in-time-compiler (JIT) help Java byte-code apps to run at a performance that makes startups rewrite their entire software when they grow up. But this amazing piece of engineering doesn’t come without a price. Even small JVM applications are known to … Read more
I have a spring boot application hosted on heroku, which uses a postgres db on heroku. I have configured config vars on heroku and am using them in my spring boot application like this : and in my code I use a connectionService: public static Connection getConnection() { try { final String dbUrl = System.getenv(“SPRING_DATASOURCE_URL”); … Read more
Joins are one of the most fundamental transformations in a typical data processing routine. A Join operator makes it possible to correlate, enrich and filter across two input datasets. The two input datasets are generally classified as a left dataset and a right dataset based on their placement with respect to the Join clause/operator. Fundamentally, … Read more
When you’re processing data with Pandas, so-called “vectorized” operations can significantly speed up your code. Or at least, that’s the theory. In practice, in some situations Pandas vectorized operations can actually make your code slower, or at least no faster. And they can also significantly increase memory usage. Let’s dig in and see what vectorization … Read more
I am new to programming with go. While following along with a tutorial to build a web project. My goal was to display some data on a web page but I got a runtime error. I looked through the error message and I think it is coming from a handler in my handlers.go file but … Read more
I have a C# MVC app for which I’m writing integration tests. I’ve been following https://docs.microsoft.com/en-us/aspnet/core/test/integration-tests?view=aspnetcore-6.0 and I created a CustomWebApplicationFactory like this in the following file: CustomWebApplicationFactory.cs using System; using System.Linq; using Microsoft.AspNetCore.Hosting; using Microsoft.AspNetCore.Mvc.Testing; using Microsoft.EntityFrameworkCore; using Microsoft.Extensions.DependencyInjection; using Microsoft.Extensions.Logging; using amaranth.Data; namespace amaranth.Tests { #region snippet1 public class CustomWebApplicationFactory<TStartup> : WebApplicationFactory<TStartup> where … Read more