AzLogDcrIngestPS
1.1.0
This module includes cmdlets to automate all the processes to create and update Azure LogAnalytics tables and Azure Data Collection Rules to do log ingestion to Azure Loganalytics custom logs using Log ingestion API and Azure Data Collection Rules from Powershell.
Functions can be used for:
(1) manipulation of source object (fix invalid struc
This module includes cmdlets to automate all the processes to create and update Azure LogAnalytics tables and Azure Data Collection Rules to do log ingestion to Azure Loganalytics custom logs using Log ingestion API and Azure Data Collection Rules from Powershell.
Functions can be used for:
(1) manipulation of source object (fix invalid structure + remove unnecessary properties + add info like UserLoggedOn, Computer, CollectionTime)
(2) Validation of environment (Azure LogAnalytics custom log tables, Azure Data Collection Rules, schema)
(3) Management (create/update) of Azure LogAnalytics tables & Azure Data Collection Rules Management - with required schema-format and valid data set
(4) Targetting of where to send data using names - lookup of DCR/DCE infrastructure using Azure Resource Graph
(5) Post data to Azure LogAnalytics custom log tables using log ingestion API and Azure Data Collection Rules
(6) Management of existing Azure Data Collection Rules
(7) Management of existing Azure LogAnalytics custom log tables & Azure Data Collection Rules to update schema when source object structure changes,
(8) Clean-up/maintenance of existing Azure LogAnalytics tables & Azure Data Collection Rules
(9) Clean-up/maintenance of existing Azure LogAnalytics custom log tables & Azure Data Collection Rules
(10) Support functions needed (e.g. REST API connectivity)
Minimum PowerShell version
5.1
Installation Options
Owners
Copyright
(c) 2023 Morten Knudsen | @knudsenmortendk
Package Details
Author(s)
- Morten Knudsen | Microsoft MVP | mok@mortenknudsen.net | @knudsenmortendk
Tags
Microsoft Azure LogAnalytics LogIngestion REST Logging CustomLogs DataCollectionRule DCR
Functions
Add-CollectionTimeToAllEntriesInArray ValidateFix-AzLogAnalyticsTableSchemaColumnNames
PSEditions
Dependencies
This module has no dependencies.
Release Notes
https://github.com/KnudsenMorten/AzLogDcrIngestPS/blob/main/RELEASENOTES
FileList
- AzLogDcrIngestPS.nuspec
- AzLogDcrIngestPS.psm1
- RELEASENOTES
- docs\Architecture.vsdx
- img\AzureDCR_AMA.jpg
- img\Concept-dcr-pipeline.png
- img\Concept-transformation-log-ingest.png
- src\Add-CollectionTimeToAllEntriesInArray.ps1
- src\CheckCreateUpdate-TableDcr-Structure.ps1
- src\CreateUpdate-AzDataCollectionRuleLogIngestCustomLog.ps1
- src\Delete-AzLogAnalyticsCustomLogTables.ps1
- src\Get-AzDceListAll.ps1
- src\Get-AzLogAnalyticsTableAzDataCollectionRuleStatus.ps1
- src\Post-AzLogAnalyticsLogIngestCustomLogDcrDce-Output.ps1
- src\Update-AzDataCollectionRuleDceEndpoint.ps1
- src\Update-AzDataCollectionRuleTransformKql.ps1
- LICENSE
- docs\Architecture.jpg
- docs\Networking.jpg
- img\AzurePipeline.jpg
- img\Concept-legacy-mma.png
- img\Concept-transformation-workspace.png
- src\Add-ColumnDataToAllEntriesInArray.ps1
- src\Convert-CimArrayToObjectFixStructure.ps1
- src\CreateUpdate-AzLogAnalyticsCustomLogTableDcr.ps1
- src\Filter-ObjectExcludeProperty.ps1
- src\Get-AzDcrDceDetails.ps1
- src\Get-ObjectSchemaAsArray.ps1
- src\Post-AzLogAnalyticsLogIngestCustomLogDcrDce.ps1
- src\Update-AzDataCollectionRuleResetTransformKqlDefault.ps1
- src\ValidateFix-AzLogAnalyticsTableSchemaColumnNames.ps1
- README.md
- docs\Architecture.png
- docs\Networking.png
- img\AzureWorkbooks.jpg
- img\Concept-transformation-ama.png
- img\LogAnalytics.jpg
- src\Build-DataArrayToAlignWithSchema.ps1
- src\Convert-PSArrayToObjectFixStructure.ps1
- src\Delete-AzDataCollectionRules.ps1
- src\Get-AzAccessTokenManagement.ps1
- src\Get-AzDcrListAll.ps1
- src\Get-ObjectSchemaAsHash.ps1
- AzLogDcrIngestPS.psd1
Version History
| Version | Downloads | Last updated |
|---|---|---|
| 1.5.0 | 156,165 | 8/27/2024 |
| 1.4.4 | 1,001,584 | 8/25/2023 |
| 1.4.3 | 450 | 8/25/2023 |
| 1.4.2 | 32 | 8/25/2023 |
| 1.4.1 | 228,824 | 6/11/2023 |
| 1.4.0 | 4,506 | 5/29/2023 |
| 1.3.0 | 7,222 | 5/4/2023 |
| 1.2.39 | 3,243 | 4/25/2023 |
| 1.2.38 | 2,678 | 4/13/2023 |
| 1.2.37 | 1,110 | 4/10/2023 |
| 1.2.36 | 618 | 4/9/2023 |
| 1.2.35 | 23 | 4/9/2023 |
| 1.2.34 | 1,069 | 4/3/2023 |
| 1.2.33 | 839 | 4/1/2023 |
| 1.2.32 | 352 | 3/31/2023 |
| 1.2.31 | 220 | 3/31/2023 |
| 1.2.30 | 129 | 3/31/2023 |
| 1.2.29 | 1,424 | 3/27/2023 |
| 1.2.28 | 43 | 3/27/2023 |
| 1.2.27 | 518 | 3/24/2023 |
| 1.2.26 | 508 | 3/22/2023 |
| 1.2.24 | 36 | 3/22/2023 |
| 1.2.23 | 11 | 3/22/2023 |
| 1.2.22 | 11 | 3/22/2023 |
| 1.2.21 | 78 | 3/21/2023 |
| 1.2.20 | 10 | 3/21/2023 |
| 1.2.19 | 10 | 3/21/2023 |
| 1.2.18 | 11 | 3/21/2023 |
| 1.2.17 | 11 | 3/21/2023 |
| 1.2.16 | 10 | 3/21/2023 |
| 1.2.15 | 10 | 3/21/2023 |
| 1.2.14 | 10 | 3/21/2023 |
| 1.2.13 | 10 | 3/21/2023 |
| 1.2.12 | 11 | 3/21/2023 |
| 1.2.11 | 11 | 3/21/2023 |
| 1.2.10 | 128 | 3/20/2023 |
| 1.2.9 | 12 | 3/20/2023 |
| 1.2.8 | 10 | 3/20/2023 |
| 1.2.7 | 10 | 3/20/2023 |
| 1.2.6 | 12 | 3/20/2023 |
| 1.2.5 | 13 | 3/15/2023 |
| 1.2.4 | 10 | 3/15/2023 |
| 1.2.3 | 10 | 3/15/2023 |
| 1.2.2 | 10 | 3/14/2023 |
| 1.2.1 | 10 | 3/13/2023 |
| 1.1.17 | 11 | 3/13/2023 |
| 1.1.16 | 11 | 3/13/2023 |
| 1.1.5 | 10 | 3/13/2023 |
| 1.1.4 | 10 | 3/13/2023 |
| 1.1.3 | 10 | 3/13/2023 |
| 1.1.2 | 10 | 3/13/2023 |
| 1.1.1 | 13 | 3/13/2023 |
| 1.1.0 (current version) | 11 | 3/13/2023 |
| 1.0.9 | 13 | 3/13/2023 |
| 1.0.8 | 11 | 3/13/2023 |
| 1.0.7 | 13 | 3/12/2023 |
| 1.0.6 | 14 | 3/12/2023 |
| 1.0.5 | 12 | 3/10/2023 |
| 1.0.4 | 12 | 3/10/2023 |
| 1.0.3 | 13 | 3/10/2023 |
| 1.0.2 | 12 | 3/10/2023 |
| 1.0.1 | 12 | 3/10/2023 |
| 1.0.0 | 12 | 3/10/2023 |