Preparation of Data - Revision history

Dahaddican: /* Preparation of Data Guidance Notes */

2021-11-21T23:19:23Z

Preparation of Data Guidance Notes

← Older revision		Revision as of 23:19, 21 November 2021
Line 31:		Line 31:

	4. [[Double-Zipping Files and Folders\|Double-Zip]] any CSV, Stata, SPSS, SAS and Excel data files (or folders containing these files) in preparation for population of the 'Shell Dataverse and Dataset' in Section 4.		4. [[Double-Zipping Files and Folders\|Double-Zip]] any CSV, Stata, SPSS, SAS and Excel data files (or folders containing these files) in preparation for population of the 'Shell Dataverse and Dataset' in Section 4.

			There is also some useful information on organising data contained in spreadsheets in the paper here: https://www.tandfonline.com/doi/full/10.1080/00031305.2017.1375989, this can be used as best practice for researchers and helps to minimise potential harmonisation downstream.

Dahaddican at 22:23, 19 January 2020

2020-01-19T22:23:17Z

← Older revision		Revision as of 22:23, 19 January 2020
Line 11:		Line 11:
	****[[File & Folder Naming Conventions]]		****[[File & Folder Naming Conventions]]
	****[[Double-Zipping Files and Folders]]		****[[Double-Zipping Files and Folders]]
	*****[[Instructions on how to Zip ~~and Encrypt a file or folder~~]]		*****[[Instructions on how to Double-Zip]]
	***[[Collection of Data]]		***[[Collection of Data]]

Dahaddican: /* Preparation of Data Guidance Notes */

2020-01-16T02:19:37Z

Preparation of Data Guidance Notes

← Older revision		Revision as of 02:19, 16 January 2020
Line 30:		Line 30:
	The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.		The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.

	4. [[Zipping ~~and Encrypting~~ Files and Folders\|Zip ~~and password Encrypt~~]] ~~the~~ data files ~~and~~ folders in preparation for population of the 'Shell Dataverse and Dataset' in Section 4.		4. [[Double-Zipping Files and Folders\|Double-Zip]] any CSV, Stata, SPSS, SAS and Excel data files (or folders containing these files) in preparation for population of the 'Shell Dataverse and Dataset' in Section 4.

	~~'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''~~

Dahaddican at 02:17, 16 January 2020

2020-01-16T02:17:18Z

← Older revision		Revision as of 02:17, 16 January 2020
Line 10:		Line 10:
	****[[Preferred Deposit Formats]]		****[[Preferred Deposit Formats]]
	****[[File & Folder Naming Conventions]]		****[[File & Folder Naming Conventions]]
	****[[Zipping ~~and Encrypting~~ Files and Folders]]		****[[Double-Zipping Files and Folders]]
	*****[[Instructions on how to Zip and Encrypt a file or folder]]		*****[[Instructions on how to Zip and Encrypt a file or folder]]
	***[[Collection of Data]]		***[[Collection of Data]]

Dahaddican at 00:30, 18 September 2019

2019-09-18T00:30:55Z

← Older revision		Revision as of 00:30, 18 September 2019
Line 11:		Line 11:
	****[[File & Folder Naming Conventions]]		****[[File & Folder Naming Conventions]]
	****[[Zipping and Encrypting Files and Folders]]		****[[Zipping and Encrypting Files and Folders]]
	*****[[Instructions on how to ~~Double-~~Zip a file or folder]]		*****[[Instructions on how to Zip and Encrypt a file or folder]]
	***[[Collection of Data]]		***[[Collection of Data]]

Dahaddican: /* Preparation of Data Guidance Notes */

2019-09-17T23:11:38Z

Preparation of Data Guidance Notes

← Older revision		Revision as of 23:11, 17 September 2019
Line 34:		Line 34:
	'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''		'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''

	If a password protected layer of encrypted zipping is not added to the file or folder prior to uploading to Dataverse, during the upload process there is a known issue with Dataverse Version 4.6.1 that removes a single layer of zipping from the file or folder. Removal of the layer of zipping can also alter the files formatting if it is one of the aforementioned file types. Therefore the password protected layer of encrypted zipping is required to ensure that a single layer remains post upload to protect not only your data from intrusion but also the original files formatting. Dataverse is unable to remove the layer of encrypted zipping if protected by a password.

	Although it is not recommended, if a password is not added you will need to double-zip the files and folders as a single layer of zipping will then be removed by Dataverse during the upload process. The double-layer of zipping will ensure that a single layer remains post upload, and therefore the files original formatting will be retained. In this case, your data will not be protected during the upload if it were to be intercepted.

	If a data file is uploaded directly with no zipping, or a only single layer of zipping without a password, dataverse will add an 'Explore' button that enables functionality that the ADA do not want available at the present time. In the event that data files are uploaded without a password protected layer of zipping or double-zipping, your deposit will not pass ADA Quakity Assurance checks and will be returned to you for rectification.

	==Notes==		==Notes==

Dahaddican: /* Preparation of Data Guidance Notes */

2019-09-17T23:10:54Z

Preparation of Data Guidance Notes

← Older revision		Revision as of 23:10, 17 September 2019
Line 30:		Line 30:
	The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.		The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.

	4. [[Zipping and Encrypting Files and Folders\|Zip and password Encrypt]] the data files and folders in preparation for ~~the~~ population of the 'Shell Dataverse and Dataset' in Section 4.		4. [[Zipping and Encrypting Files and Folders\|Zip and password Encrypt]] the data files and folders in preparation for population of the 'Shell Dataverse and Dataset' in Section 4.

	'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''		'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''

Dahaddican: /* Preparation of Data Guidance Notes */

2019-09-17T23:07:41Z

Preparation of Data Guidance Notes

← Older revision		Revision as of 23:07, 17 September 2019
Line 30:		Line 30:
	The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.		The correct naming of files and folders ensures that both the ADA Staff and secondary users are able to easily identify the files when accessing the information through Dataverse.

	4. [[~~Double-~~Zipping Files and Folders\|~~Double-~~Zip]] the data files and folders in preparation for the population of the 'Shell Dataverse and Dataset' in Section 4.		4. [[Zipping and Encrypting Files and Folders\|Zip and password Encrypt]] the data files and folders in preparation for the population of the 'Shell Dataverse and Dataset' in Section 4.

	~~Double-zipping~~ is required on all data files and folder uploads. A single layer of zipping is removed by Dataverse during the upload process and if a layer of zipping is not retained post upload, there is a known issue in Dataverse Version 4.6.1 that removes formatting from certain file ~~types~~ (~~SPSS,~~ Stata, ~~SAS~~, CSV and Excel ~~file extension types~~). ~~Therefore the double-zipping of files and folders is required to ensure that a single layer remains post upload to protect any file formatting.~~		'''Zipping and password encryption is required on all data files and some supporting documentation file formats (Stata, SPSS, CSV and Excel files).'''

	In ~~addition~~, if ~~the~~ data file ~~or folder~~ is uploaded directly ~~without any layers~~ of zipping, dataverse ~~adds~~ an 'Explore' button that enables functionality that the ADA do not want available at the present time..		If a password protected layer of encrypted zipping is not added to the file or folder prior to uploading to Dataverse, during the upload process there is a known issue with Dataverse Version 4.6.1 that removes a single layer of zipping from the file or folder. Removal of the layer of zipping can also alter the files formatting if it is one of the aforementioned file types. Therefore the password protected layer of encrypted zipping is required to ensure that a single layer remains post upload to protect not only your data from intrusion but also the original files formatting. Dataverse is unable to remove the layer of encrypted zipping if protected by a password.

			Although it is not recommended, if a password is not added you will need to double-zip the files and folders as a single layer of zipping will then be removed by Dataverse during the upload process. The double-layer of zipping will ensure that a single layer remains post upload, and therefore the files original formatting will be retained. In this case, your data will not be protected during the upload if it were to be intercepted.

			If a data file is uploaded directly with no zipping, or a only single layer of zipping without a password, dataverse will add an 'Explore' button that enables functionality that the ADA do not want available at the present time. In the event that data files are uploaded without a password protected layer of zipping or double-zipping, your deposit will not pass ADA Quakity Assurance checks and will be returned to you for rectification.

	==Notes==		==Notes==

Dahaddican at 22:42, 17 September 2019

2019-09-17T22:42:45Z

← Older revision		Revision as of 22:42, 17 September 2019
Line 10:		Line 10:
	****[[Preferred Deposit Formats]]		****[[Preferred Deposit Formats]]
	****[[File & Folder Naming Conventions]]		****[[File & Folder Naming Conventions]]
	****[[~~Double-~~Zipping Files and Folders]]		****[[Zipping and Encrypting Files and Folders]]
	*****[[Instructions on how to Double-Zip a file or folder]]		*****[[Instructions on how to Double-Zip a file or folder]]
	***[[Collection of Data]]		***[[Collection of Data]]

Dahaddican at 23:00, 26 August 2019

2019-08-26T23:00:50Z

← Older revision		Revision as of 23:00, 26 August 2019
Line 1:		Line 1:
			*[[2. Deposit Preparation]]
			**[[Collect and Prepare Data File(s)]]
			***[[Preparation of Data]]
			****[[The Privacy Act 1988]]
			****[[De-Identification]]
			****[[Primary Risks Associated with Data Breach]]
			****[[Common Disclosure Risk Factors]]
			****[[Data Protections]]
			****[[Data Treatment Techniques]]
			****[[Preferred Deposit Formats]]
			****[[File & Folder Naming Conventions]]
			****[[Double-Zipping Files and Folders]]
			*****[[Instructions on how to Double-Zip a file or folder]]
			***[[Collection of Data]]

	In order to [[Collection of Data\|collect data]], it does not matter whether the [[Glossary of Terms\|Data Custodian]] or [[Glossary of Terms\|Data Owner]] has a relationship with the relevant [[Glossary of Terms\|Data Subject]], or whether the data and any [[Glossary of Terms\|Personal Information]] contained within it, was initially processed or obtained from the [[Glossary of Terms\|Data Subject]] by another entity. However, by collecting any form of [[Glossary of Terms\|Personal Information]], the [[Glossary of Terms\|Data Custodian]] and [[Glossary of Terms\|Data Owner]] will be bound by [[The Privacy Act 1988\|The Privacy Act 1988]]. This means that both the [[Glossary of Terms\|Data Custodian]] and [[Glossary of Terms\|Data Owner]] have a responsibility to ensure that the identity of [[Glossary of Terms\|Data Subjects]] is protected. To do this correctly, a number of [[Data Protections]] may need to be carried out to prepare the data for depositing.		In order to [[Collection of Data\|collect data]], it does not matter whether the [[Glossary of Terms\|Data Custodian]] or [[Glossary of Terms\|Data Owner]] has a relationship with the relevant [[Glossary of Terms\|Data Subject]], or whether the data and any [[Glossary of Terms\|Personal Information]] contained within it, was initially processed or obtained from the [[Glossary of Terms\|Data Subject]] by another entity. However, by collecting any form of [[Glossary of Terms\|Personal Information]], the [[Glossary of Terms\|Data Custodian]] and [[Glossary of Terms\|Data Owner]] will be bound by [[The Privacy Act 1988\|The Privacy Act 1988]]. This means that both the [[Glossary of Terms\|Data Custodian]] and [[Glossary of Terms\|Data Owner]] have a responsibility to ensure that the identity of [[Glossary of Terms\|Data Subjects]] is protected. To do this correctly, a number of [[Data Protections]] may need to be carried out to prepare the data for depositing.