Vector E TechUnderstanding Slowly Changing Dimension (SCD) Type 2SCD Type 2, known as Slowly Changing Dimension Type 2, is a strategy applied in data warehousing to manage changes in dimensional data…Dec 2, 20235Dec 2, 20235
InArt of Data EngineeringbyNnamdi SamuelMy First Data Modeling Project: Design For Global Superstore SalesThe global superstore is a fictitious company that specializes in the sales of office supplies, furniture, and products of technology. It…Aug 2, 20232Aug 2, 20232
InDev GeniusbyAhmed SayedMastering PySpark: From Configuration to Advanced Data Operations for Data EngineersWhy PySpark?Aug 25, 20234Aug 25, 20234
InDev GeniusbyAmit Singh RathoreSpark Questions — Interview SeriesSeries on spark question we should know before an interviewSep 17, 20231Sep 17, 20231
InAccredianbyMukesh KumarSetting Up Celery, Flower, & RabbitMQ for Airflow(A Prerequisite for Setting up Celery Executor in Airflow)Aug 26, 20221Aug 26, 20221
InDataDrivenInvestorbymobin shaterianI struggle to read and write 100K requests in Postgres DB, and my aggressive solution with Redis.I faced 100K requests in a short period in our application. In that situation, Postgres Database has a lot of delays in response requests…Aug 15, 20228Aug 15, 20228
InDev GeniusbyHaq NawazExtract data from on-premise SQL Server and load it to Google’s BigQuery with AirflowUsing Airflow, BigQuery, Python, SQL ServerAug 12, 20221Aug 12, 20221
InThe DevOps CornerbyAnna Geller3 Tricks to Make Your Python Projects More SophisticatedSharing tricks that helped me in data engineering with PythonFeb 26, 2021Feb 26, 2021
InK2 Data Science & EngineeringbyTy ShaikhReal-Time Data Sources for Data Engineering ProjectsThe best way to learn data engineering is to build data processing pipelines that handle big data. It’s not that easy to find free big…Jan 10, 20193Jan 10, 20193