Friday, December 8, 2023

Recovery Model

 Contents

1 Recovery Model Overview

2 Simple vs Full vs Bulk-Logged

3 Ref

  1. Recovery Model Overview

  • A recovery model is a database property that controls how transactions are logged, whether the transaction log requires (and allows) backing up, and what kinds of restore operations are available. 

  • Three recovery models exist: simple, full, and bulk-logged. Typically, a database uses the full recovery model or simple recovery model. 

  • A database can be switched to another recovery model at any time.

  1. Simple vs Full vs Bulk-Logged

Recovery model

Description

Work loss exposure

Recover to point in time?

Simple

No log backups.

Automatically reclaims log space to keep space requirements small, essentially eliminating the need to manage the transaction log space. For information about database backups under the simple recovery model, see Full Database Backups (SQL Server).

Operations that require transaction log backups are not supported by the simple recovery model. The following features cannot be used in the simple recovery model:

-Log shipping

-Always On or Database mirroring

-Media recovery without data loss

-Point-in-time restores

Changes since the most recent backup are unprotected. In the event of a disaster, those changes must be redone.

Can recover only to the end of a backup. For more information, see Complete Database Restores (Simple Recovery Model).

For a more in depth explanation of the Simple recovery model, see SQL Server Simple Recovery Model provided by the folks at MSSQLTips!

Full

Requires log backups.

No work is lost due to a lost or damaged data file.

Can recover to an arbitrary point in time (for example, prior to application or user error). For information about database backups under the full recovery model, see Full Database Backups (SQL Server) and Complete Database Restores (Full Recovery Model).

Normally none.

If the tail of the log is damaged, changes since the most recent log backup must be redone.

Can recover to a specific point in time, assuming that your backups are complete up to that point in time. For information about using log backups to restore to the point of failure, see Restore a SQL Server Database to a Point in Time (Full Recovery Model).

Note: If you have two or more full-recovery-model databases that must be logically consistent, you may have to implement special procedures to make sure the recoverability of these databases. For more information, see Recovery of Related Databases That Contain Marked Transaction.

Bulk logged

Requires log backups.

An adjunct of the full recovery model that permits high-performance bulk copy operations.

Reduces log space usage by using minimal logging for most bulk operations. For information about operations that can be minimally logged, see The Transaction Log (SQL Server).

Log backups may be of a significant size because the minimally-logged operations are captured in the log backup. For information about database backups under the bulk-logged recovery model, see Full Database Backups (SQL Server) and Complete Database Restores (Full Recovery Model).

If the log is damaged or bulk-logged operations occurred since the most recent log backup, changes since that last backup must be redone.

Otherwise, no work is lost.

Can recover to the end of any backup. Point-in-time recovery is not supported.


  1. Ref

https://learn.microsoft.com/en-us/sql/relational-databases/backup-restore/recovery-models-sql-server?view=sql-server-ver16


Friday, November 3, 2023

SSIS_Home

 



1 Ref 5

1.1 MS SQL SSIS Link 5

2 General 5

3 Overview 6

3.1 SSIS Architecture 6

4 SSIS IDE - Designer Tabs 7

4.1 1.2.1 Control Flow 7

4.2 1.2.2 Data Flow 7

4.3 1.2.3 Event Handler 7

4.4 1.2.4 Package Explorer 7

4.5 1.2.5 Progress / Execution Results 7

4.6 Log 8

4.6.1 1.3.1 Logging Events 8

4.6.2 1.3.2 SSIS Log Provider 8

4.6.2.1 1.3.2.1 Text Files 8

4.6.2.2 1.3.2.2 SQL Server 8

4.6.2.3 1.3.2.3 SQL Server Profiler 9

4.6.2.4 1.3.2.4 Windows Event Log 9

4.6.2.5 1.3.2.5 XML file 9

4.7 1.4 Package 9

4.7.1 1.4.1 Config 9

4.7.1.1 1.4.1.1 XML configuration file 9

4.7.1.2 1.4.1.2 Environment Variable 9

4.7.1.3 1.4.1.3 Registry 9

4.7.1.4 1.4.1.4 Parent Package 9

4.7.2 1.4.2 Checkpoint 9

4.7.3 1.4.3 Variables 9

4.7.4 1.4.4 Expression 9

4.7.5 1.4.5 Deployment Model 9

4.7.6 1.4.6 Transaction 9

5 A 10

6 Connection Managers 10

6.1 ADO 10

6.2 ADO.NET 10

6.3 CACHE 10

6.4 DQS 10

6.5 EXCEL 10

6.6 FILE 10

6.7 FLATFILE 10

6.8 FTP 10

6.9 HADOOP 10

6.10 HTTP 10

6.11 MSMQ 10

6.12 MSOLAP100 10

6.13 MULTIFILE 10

6.14 MULTIFLATFILE 10

6.15 ODATA 10

6.16 OLEDB 10

6.17 ODBC 10

6.18 SMOServer 10

6.19 SMTP 10

6.20 SQLMOBILE 10

6.21 WMI 10

6.22 Azure Storage (can download) 10

6.23 Azure Subscription (can download) 10

6.24 ORACLE (can download) 10

6.25 SAPBI (can download) 10

6.26 TERADATA (can download) 10

7 Control Flow 10

7.1 Integration Services Containers 10

7.1.1 Foreach Loop Container 10

7.1.2 For Loop Container 11

7.1.3 Sequence Container 11

7.1.4 Task Host Container 11

7.1.5 Group Container 11

7.1.6 A 11

7.2 Integration Services Tasks 11

7.2.1 Analysis Services Execute DDL Task 11

7.2.2 Analysis Services Processing Task 11

7.2.3 Azure Blob Download Task 11

7.2.4 Azure Blob Upload Task 11

7.2.5 Azure Data Lake Analytics Task 11

7.2.6 Azure Data Lake Store File System Task 11

7.2.7 Azure HDInsight Create Cluster Task 11

7.2.8 Azure HDInsight Delete Cluster Task 11

7.2.9 Azure HDInsight Hive Task 11

7.2.10 Azure HDInsight Pig Task 11

7.2.11 Azure SQL DW Upload Task 11

7.2.12 Flexible File Task 11

7.2.13 Back Up Database Task 11

7.2.14 Bulk Insert Task 11

7.2.15 CDC Control Task 11

7.2.16 Check Database Integrity Task 12

7.2.17 Data Flow Task 12

7.2.18 Data Mining Query Task 12

7.2.19 Data Profiling Task and Viewer 12

7.2.20 Execute Package Task 12

7.2.21 Execute Process Task 12

7.2.22 Execute SQL Task 12

7.2.23 Execute SQL Server Agent Job Task 12

7.2.24 Execute T-SQL Statement Task 12

7.2.25 Expression Task 12

7.2.26 File System Task 12

7.2.27 FTP Task 12

7.2.28 Hadoop File System Task 12

7.2.29 Hadoop Hive Task 12

7.2.30 Hadoop Pig Task 12

7.2.31 History Cleanup Task 12

7.2.32 Maintenance Cleanup Task 12

7.2.33 Notify Operator Task 12

7.2.34 Rebuild Index Task 12

7.2.35 Reorganize Index Task 12

7.2.36 Script Task 12

7.2.37 Send Mail Task 12

7.2.38 Shrink Database Task 12

7.2.39 Transfer Database Task 12

7.2.40 Transfer Error Messages Task 12

7.2.41 Transfer Jobs Task 12

7.2.42 Transfer Logins Task 12

7.2.43 Transfer Master Stored Procedures Task 12

7.2.44 Transfer SQL Server Objects Task 12

7.2.45 Select Objects to Transfer 12

7.2.46 Update Statistics Task 12

7.2.47 Web Service Task 12

7.2.48 WMI Data Reader Task 12

7.2.49 WMI Event Watcher Task 12

7.2.50 XML Task 12

7.3 Precedence Constraints 12

7.3.1 Success 13

7.3.2 Failure 13

7.3.3 Completion 13

7.4 Expression/Constraint with logical 13

8 Data Flow 13

9 Transformation 13

9.1 Aggregate Transformation 13

9.2 Audit Transformation 13

9.3 Balanced Data Distributor Transformation 13

9.4 Character Map Transformation 13

9.5 Conditional Split Transformation 13

9.6 Copy Column Transformation 13

9.7 Data Conversion Transformation 13

9.8 Data Mining Query Transformation 13

9.9 DQS Cleansing Transformation 13

9.10 Derived Column Transformation 13

9.11 Export Column Transformation 13

9.12 Fuzzy Grouping Transformation 13

9.13 Fuzzy Lookup Transformation 13

9.14 Import Column Transformation 13

9.15 Lookup Transformation 13

9.16 Merge Transformation 13

9.17 Merge Join Transformation 13

9.18 Multicast Transformation 13

9.19 OLEDB Command Transformation 13

9.20 Percentage Sampling Transformation 14

9.21 Pivot Transformation 14

9.22 Row Count Transformation 14

9.23 Row Sampling Transformation 14

9.24 Script Component 14

9.25 Slowly Changing Transformation 14

9.26 Sort Transformation 14

9.27 Term Extraction Transformation 14

9.28 Term Lookup Transformation 14

9.29 Union All Transformation 14

9.30 Unpivot Transformation 14

9.31 Transform Data with Transformations 14

9.32 Transformation Custom Properties 14

10 6 Terminology: 14

10.1 6.1 SSISDB Database 14

10.2 6.2 SSISDB catalog 14

10.3 6.3 Deployment: 14

11 A 15


Terms:

RetainSameConnection Property,