SqlPipeline
0.3.6
Apteco PS Modules - Wrapper for SimplySQL
Minimum PowerShell version
5.1
Installation Options
Owners
Copyright
(c) 2026 Apteco GmbH. All rights reserved.
Package Details
Author(s)
- florian.von.bracht@apteco.de
Tags
powershell Windows Linux Apteco
Functions
Add-RowsToSql Add-RowsToDuckDB Invoke-IncrementalLoad New-DuckDBConnection Initialize-SQLPipeline Close-SqlPipeline Get-LastLoadTimeStamp Get-DuckDBData Invoke-DuckDBQuery Set-LoadMetadata Export-DuckDBToParquet Show-DuckDBConnection Install-SqlPipeline
PSEditions
Dependencies
Release Notes
0.3.6 Adding functionality to count updates and inserts when executing the MERGE
0.3.5 Added function to show open DuckDB connections: Show-DuckDBConnection
0.3.4 Fixing package installation with PowerShell 5.1 because Expand-Archive only supports *.zip files
0.3.3 Extending Install-SqlPipeline to install DuckDB.net 1.4.4 when using PowerShell 5.1 (latest supported version), pwsh is supporting all latest versions
Fixing to not cancel the module import if SimplySQL does not match the current processor architecture
Fixing returned values for last loaded timestamp, duckdb columns, existing table, Get-DuckDB data in general
Fixing datatype matching for DuckDB, as there is not Int32
Fixing the fallback of a closed connection to existing in-memory connection
0.3.2 Renaming Close-DuckDBConnection to Close-SqlPipeline to not clash with Close-DuckDBConnection of AptecoPSFramework (which is used for direct DuckDB connections outside of SqlPipeline)
0.3.1 Skipping comparison with complex datatypes with -SimpleTypesOnly for better import performance
Adding a csv importer to export big files first into a temporary file and directly import them via DuckDB into a staging table
Added quotations around column names for duckdb support
0.3.0 Added DuckDB.net support through Add-RowsToDuckDB and more
Added verbose output when importing module
Better usage of ImportDependency to recognize if local package dependencies are already loaded
Added local package installation for DuckDB.net (not needed for Add-RowsToSql, only for Add-RowsToDuckDB): Install-SqlPipeline
Added function to export DuckDB tables to Parquet: Export-DuckDBToParquet
0.2.1 Changing the way to look for existing tables
0.2.0 Support of Linux
0.1.5 Fixing case sensitive path for private and public functions
0.1.4 Prefixing SimplySql commands
Integration of ImportDependency module
0.1.3 Removing unnecessary Code
0.1.2 Throwing an exception now, when no transaction is used and the input is not valid
0.1.1 Fixed temporary module and script path loading
0.1.0 Improved the check for existing tables and columns. In this case the table will not be dropped the the SimplySQL update.
0.0.7 Bumped the copyright year to 2024
0.0.6 Fix of trimming when datatype is boolean or something else than String
0.0.5 Automatically trim values now, but there is a parameter to deactivate this behaviour
0.0.4 Adding support for Object[] and ArrayList to be converted into JSON, too
0.0.3 Fix for table existing check and prevent using more columns than needed (the leaded to overwriting columns that have default values like changedate)
0.0.2 Small fix for tables that are already existing, but empty
0.0.1 Initial release of SqlPipeline
FileList
- SqlPipeline.nuspec
- Private\SqlPipeline\Import-Package.ps1
- Private\SqlPipeline\Install-NuGetPackage.ps1
- Private\duckdb\ConvertTo-DuckDBType.ps1
- Private\duckdb\ConvertTo-DuckDBValue.ps1
- Private\duckdb\Get-DuckDBColumns.ps1
- Private\duckdb\Initialize-DuckDBTable.ps1
- Private\duckdb\Initialize-PipelineMetadata.ps1
- Private\duckdb\Invoke-BufferedWrite.ps1
- Private\duckdb\Invoke-DuckDBUpsert.ps1
- Private\duckdb\New-DuckDBConnection.ps1
- Private\duckdb\Repair-DuckDBRow.ps1
- Private\duckdb\Sync-DuckDBSchema.ps1
- Private\duckdb\Test-DuckDBTableExists.ps1
- Private\duckdb\Write-DuckDBAppender.ps1
- Private\duckdb\Write-DuckDBCsv.ps1
- Public\SqlPipeline\Install-SqlPipeline.ps1
- Public\duckdb\Add-RowsToDuckDB.ps1
- Public\duckdb\Close-SqlPipeline.ps1
- Public\duckdb\Export-DuckDBToParquet.ps1
- Public\duckdb\Get-DuckDBData.ps1
- Public\duckdb\Get-LastLoadTimestamp.ps1
- Public\duckdb\Initialize-SQLPipeline.ps1
- Public\duckdb\Invoke-DuckDBQuery.ps1
- Public\duckdb\Set-LoadMetadata.ps1
- Public\duckdb\Show-DuckDBConnection.ps1
- Public\simplysql\Add-RowsToSql.ps1
- SqlPipeline.psd1
- SqlPipeline.psm1
- bin\dependencies.ps1
Version History
| Version | Downloads | Last updated |
|---|---|---|
| 0.3.6 (current version) | 4 | 3/30/2026 |
| 0.3.5 | 3 | 3/30/2026 |
| 0.3.4 | 3 | 3/30/2026 |
| 0.3.3 | 2 | 3/30/2026 |
| 0.3.2 | 4 | 3/27/2026 |
| 0.3.1 | 5 | 3/27/2026 |
| 0.3.0 | 4 | 3/25/2026 |
| 0.2.1 | 27 | 10/1/2025 |
| 0.2.0 | 7 | 9/30/2025 |
| 0.1.5 | 4 | 9/30/2025 |
| 0.1.4 | 7 | 9/30/2025 |
| 0.1.3 | 7 | 9/26/2025 |
| 0.1.2 | 5 | 9/26/2025 |
| 0.1.1 | 15 | 3/19/2025 |
| 0.1.0 | 15 | 1/27/2025 |
| 0.0.7 | 16 | 6/24/2024 |
| 0.0.6 | 29 | 11/14/2023 |
| 0.0.5 | 12 | 11/13/2023 |
| 0.0.4 | 9 | 11/11/2023 |
| 0.0.3 | 11 | 11/8/2023 |
| 0.0.2 | 11 | 11/8/2023 |
| 0.0.1 | 11 | 11/7/2023 |