Data Engineering with Salim Saeedi
AWS and Azure Musings
admin At the moment Azure Data Factory expressions and functions are limited and there is not try-catch if you need to make the code to behave differently in case an activity’s output was success or fail. Here is a workaround: Suppose you have a lookup and you need to set the variable based on the output … Read more
Below is the typical MERGE statement for SCD Type 2: Since a MERGE statement cannot update more than one match at a time, in scenarios which the source contains historical data that for each matching key (per ON statament) may need more than 1 action in a single merge statement run (e.g. one INSERT and … Read more
Dynamic 365 provides an Audit History in all pages. In case you need to export these data or have a query to the data, Dynamics API provides this access. In Power BI, OData Feed enables this access. In order to achieve this: Use OData source and point it to “audits” entity. Refer to Microsoft’s Web … Read more
Problem: You are trying to install or uninstall a python package via pipenv and receive: “Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.”
How a filter in Power BI can be dynamic and reflect other slicers and interaction in the dashboard?
How to set up Azure DevOps for Git Version Control
Problem In SSIS, OLE DB Command is used as a part of Data Flow to run SQL codes to transform data. Is it possible to use one of the parameters as a return value? Solution Returning values in SSIS OLE DB Command task is possible but the limitation is you can only return one value … Read more
Suppose you have a SQL Stored Procedure and need to prvenet users or processes to run it concurrently.
How to shrink a SQL Database and manage log file size?
A tutorial to develop an application using AWS services to send tweets on a regular basis – based on data in a database.