Double-Zipping Files and Folders: Difference between revisions

From ADA Public Wiki
Jump to navigation Jump to search
m Dahaddican moved page Double-Zipping Files and Folders to Zipping and Encrypting Files and Folders: Update required since no longer need to Double-Zip all data files and some Supporting Documents if they are encrypted with a password since Data...
No edit summary
Line 1: Line 1:
Double-Zipping is required in order to ensure that the files remain compatible with Dataverse and to keep all files consistent. It is a known issue that Dataverse Version 4.6.1 cannot directly ingest certain file types (SAS, SPSS, Stata, Excel and CSV) without removing some of the formatting. Dataverse Version 4.6.1 also adds an ‘Explorer’ function button to directly ingested files and that enables a functionality that the ADA does not currently want at this point in time. To prevent both of the above, and also to cater for the fact that Dataverse strips away the first layer of zipping during the ingest process, all data files and those supporting documentation files that are in any of the aforementioned formats must be Double-Zipped prior to ingest to Dataverse. This leaves a single layer of zip attached to the files post ingest, the files integrity is then retained, and the files are present in their original format without the explorer function.
The zipping and password encryption of files is required in order to ensure that the files remain compatible with Dataverse and to keep all files consistent. It is a known issue that Dataverse Version 4.6.1 cannot directly ingest certain file types (SAS, SPSS, Stata, Excel and CSV) without removing some of the files original formatting. Dataverse Version 4.6.1 also adds an ‘Explorer’ function button to directly ingested files, this enables a functionality that the ADA does not currently want. To prevent both of the above, and also to cater for the fact that Dataverse strips away the first layer of zipping during the ingest process, all data files and those supporting documentation files that are in any of the aforementioned formats must be zipped with a password protected layer of encryption prior to ingest to Dataverse. The password prevents Dataverse from removing the layer of zipping, the files integrity is then retained, and the files are present in their original format without the explorer function. in addition, the data is protected through the password protection.


If there is an excessive number of files to upload, it is possible to ingest multiple files as a single downloadable folder, however this folder also needs to be uploaded as a double-zipped folder. This is for the same reasons as above.
If there are an excessive number of data or supporting files that require zipping and password protected encryption prior to upload, it is possible to ingest multiple files as a single downloadable folder. This does mean that the files are unable to be given File Tags or Description Notes. Before uploading files in a folder, you should [[Contact the ADA|contact the ADA]]. When approved by the ADA, the folder will then need to be uploaded zipped with password protected encryption for the same reasons as above.


Files and/or folders that are not correctly prepared may not be ingested by Dataverse correctly. Furthermore, files and/or folders that are discovered to have been uploaded incorrectly by ADA Staff during their Quality Assurance checks will need to be rectified prior to publishing. This will add unnecessary delays to the publishing of the Dataverse.  
If a password protected layer of encrypted zipping is not added to the file or folder prior to uploading to Dataverse, during the upload process there is a known issue with Dataverse Version 4.6.1 that removes a single layer of zipping from the file or folder. Removal of the layer of zipping can also alter the files formatting if it is one of the aforementioned file types. Therefore the password protected layer of encrypted zipping is required to ensure that a single layer remains post upload to protect not only your data from intrusion but also the original files formatting. Dataverse is unable to remove the layer of encrypted zipping if protected by a password.
 
Although it is not recommended, if a password is not added you will need to double-zip the files and folders as a single layer of zipping will then be removed by Dataverse during the upload process. The double-layer of zipping will ensure that a single layer remains post upload, and therefore the files original formatting will be retained. In this case, your data will not be protected during the upload if it were to be intercepted.
 
If a data file is uploaded directly with no zipping, or a only single layer of zipping without a password, Dataverse will add an 'Explore' button that enables functionality that the ADA do not want available at the present time. In the event that data files are uploaded without a password protected layer of zipping or double-zipping, your deposit will not pass ADA Quality Assurance checks and will be returned to you for rectification, delaying the publication of your deposit.


= 7-Zip Software =
= 7-Zip Software =

Revision as of 23:24, 17 September 2019

The zipping and password encryption of files is required in order to ensure that the files remain compatible with Dataverse and to keep all files consistent. It is a known issue that Dataverse Version 4.6.1 cannot directly ingest certain file types (SAS, SPSS, Stata, Excel and CSV) without removing some of the files original formatting. Dataverse Version 4.6.1 also adds an ‘Explorer’ function button to directly ingested files, this enables a functionality that the ADA does not currently want. To prevent both of the above, and also to cater for the fact that Dataverse strips away the first layer of zipping during the ingest process, all data files and those supporting documentation files that are in any of the aforementioned formats must be zipped with a password protected layer of encryption prior to ingest to Dataverse. The password prevents Dataverse from removing the layer of zipping, the files integrity is then retained, and the files are present in their original format without the explorer function. in addition, the data is protected through the password protection.

If there are an excessive number of data or supporting files that require zipping and password protected encryption prior to upload, it is possible to ingest multiple files as a single downloadable folder. This does mean that the files are unable to be given File Tags or Description Notes. Before uploading files in a folder, you should contact the ADA. When approved by the ADA, the folder will then need to be uploaded zipped with password protected encryption for the same reasons as above.

If a password protected layer of encrypted zipping is not added to the file or folder prior to uploading to Dataverse, during the upload process there is a known issue with Dataverse Version 4.6.1 that removes a single layer of zipping from the file or folder. Removal of the layer of zipping can also alter the files formatting if it is one of the aforementioned file types. Therefore the password protected layer of encrypted zipping is required to ensure that a single layer remains post upload to protect not only your data from intrusion but also the original files formatting. Dataverse is unable to remove the layer of encrypted zipping if protected by a password.

Although it is not recommended, if a password is not added you will need to double-zip the files and folders as a single layer of zipping will then be removed by Dataverse during the upload process. The double-layer of zipping will ensure that a single layer remains post upload, and therefore the files original formatting will be retained. In this case, your data will not be protected during the upload if it were to be intercepted.

If a data file is uploaded directly with no zipping, or a only single layer of zipping without a password, Dataverse will add an 'Explore' button that enables functionality that the ADA do not want available at the present time. In the event that data files are uploaded without a password protected layer of zipping or double-zipping, your deposit will not pass ADA Quality Assurance checks and will be returned to you for rectification, delaying the publication of your deposit.

7-Zip Software

It is recommended by the ADA that all data files and certain supporting documents be encrypted using the 7-Zip open source software. This software is used by the ADA Staff and is free. This ensures that the files and folders are protected from unauthorised disclosure during the Dataverse upload process. The software creates a container called ‘archive’ that holds the files requiring protection. That archive container can then be encrypted and password protected. Copies of the software can be obtained via the links at https://www.7-zip.org/.

How to Double-Zip

For instructions on how to Double-Zipp files and folders using the 7-Zip software, refer to the page detailed below.