Linking community and technology to enable FAIR data

Tools Confluence
DISQOVER
DMPMaastricht
Maastricht Data Repository

Page tree

Linking community and technology to enable FAIR data

Skip to end of metadata
Go to start of metadata

 User manual


Downloading data from the Maastricht Data Repository is possible through the ProjectCollection browser or via WebDAV clients.


The ProjectCollection browser is very suited for downloading single files under 1 GiB in size.
To download larger files, multiple files or even entire subfolders, use one of the WebDAV methods instead.



Project Collection browser

Step 1 - Open MDR

Point your browser to https://mdr.datahubmaastricht.nl/
Use the menu on the left side to login with your UM- or MUMC+ credentials.




Step 2 - Access data

Click the Access data - Projects link in the menu



Step 3 - List projects

Click on the project of your choice in the projects overview table




Step 4 - List Project Collections

Click on the collection of your choice in the collection overview table



Step 5 - List contents of project collection and download files

On this page you can browse the data set and download individual files. 










WebDAV

Using the WebDAV protocol is a convenient way to download data from DataHub. WebDAV is compatible with multiple software tools and libraries, such as web browsers, WinSCP, operating system-specific file browsers and Cyberduck. 

In this manual we limit ourselves to the use of web browsers, Cyberduck, Windows Explorer and RaiDrive.


Common steps



Step 1 - Open MDR

Open the Direct download page in MDR.
This page can also be accessed by clicking the Access data - Direct download menu item.






Step 2 - Generate a temporary password (24 hour life time)

You will find your user name and a generated password on the Direct download page 


Top tip!

The buttons on the right immediately copy the contents of the box to your clipboard.


for Cyberduck

Step 3 - Download, Open and Connect via Cyberduck

Use the appropriate buttons. Make sure that Cyberduck (or another WebDAV compatible application) is installed before using the "Open" button



Step 4 - Enter the connection information in Cyberduck

Click on Open Connection.


Choose WebDAV(HTTPS) in the upper dropdown. 

Enter the login information

  • Server -  webdav.prod.rit.unimaas.nl/
  • Port - 443
  • Username - this is the username you copied from the previous step
  • Password - this is the password you copied from the previous step

You many need to uncheck the Anonymous Login check box to input your username and password

Click Connect. When the login is successful, you will see your collections.







for Internet Browser 

Step 3 - Open, Connect and browse through your favorite browser


Use the Open WebDAV in browser button to open a new tab for https://webdav.prod.rit.unimaas.nl/ 



You will get a pop-up requesting a username and password. 

  • Username - this is the username you copied from the previous step
  • Password - this is the password you copied from the previous step


After entering these credentials you will be able to browse through your data and download your data. 






for Windows Explorer

There is a known limitation in the default WebDAV driver for Windows. The maximum filesize is set to 50 MB and can be expanded to about 4 GB using a registry hack.


More information on how to change this setting can be found on the Microsoft Support website.
Be aware that changing the Windows registry is risky and if you decide to do so, it is on your own risk!

Instead, for transferring large files, we recommend to use the Cyberduck client (described above).

 I'm willing to take that risk...
1. Open regedit
2. Navigate to HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\WebClient\Parameters
3. Change the value of 'FileSizeLimitInBytes' to the maximum of 4294967295


Step 3 - Add WebDAV in Windows 


Open My Computer ( + E)

Click Map network drive 

Click Finish and enter the credentials from the previous step.

Press OK and you can now browse and copy the data from the drive letter you chose.





for RaiDrive

Step 3 - Download and install RaiDrive

Download RaiDrive from https://www.raidrive.com/download

Then install RaiDrive to your computer.


Windows Firewall

RaiDrive creates 3 inbound rules in the Windows Firewall. DataHub recommends to delete these rules after installation.

Instructions: 

  • Search for Windows Defender Firewall in the Windows start menu and open it
  • Choose Advanced settings
  • Click Inbound Rules
  • Delete the rules called
    • RaiDrive Center 
    • RaiDrive Service
    • RaiDrive Updater


Step 4 - Enter the connection details in RaiDrive

Open RaiDrive using the shortcut on your desktop or in the start menu.

  • Click + Add
  • Choose the NAS tab
  • Choose WebDAV
  • Choose a drive letter 
    RaiDrive lets you select drive letters that are already in use, so make sure that this drive letter is still available.

  • (optional) Enter a name for the drive (eg. DataHub WebDAV)
  • Uncheck Reconnect at program start
  • Check Connect using different credentials
  • At Address enter webdav.prod.rit.unimaas.nl
  • Port 443
  • Username - this is the username you copied from the previous step
  • Password - this is the password you copied from the previous step


Step 5 - RaiDrive WebDAV connection is active

The RaiDrive application now shows an active connection.

  • Connection can be stopped and started using the stop/start button
  • Connection details can be changed using the gear icon

Using Windows Explorer you can now browse and copy the data from the drive letter you chose.



  

Step 3 - Windows Firewall

Step 4 - Add a new WebDAV connection


Step 4 - Enter the connection details


 

Step 5 - WebDAV connection is active


for Linux

There are several ways to access WebDAV in Linux. We recommend the following two ways.

  1. Mount WebDAV through davfs2
  2. Download a collection directly through wget

There are advantages and disadvantages to both methods. Using wget you will download the entire collection directly and fast to your local share.

davfs2 will make all files of a collection accessible without downloading all. Furthermore it caches files that were opened before speeding up repeated access. This can be a benefit in certain applications. But can be a drawback when many big files need to be downloaded.

davfs2
# Make sure the package davfs2 has been installed
sudo mount -t davfs https://webdav.prod.rit.unimaas.nl /path/to/mount
wget
/usr/bin/wget \
    --mirror \   
    --no-host-directories \
    --no-parent \
    --reject 'index.*' \
    --user <user>@maastrichtuniversity.nl \
    --ask-password \
    https://webdav.prod.rit.unimaas.nl/P000000001/C000000001/

Troubleshooting

Please find below the answers to some common problems and errors 

HTTP 401 Unauthorized error

This error mostly occurs when the lifetime (24 hours) of the generated password has expired. Please generate a new password on the MDR - Access data - Direct download page.


HTTP 500 Internal server error

If you encounter one of these errors while downloading a file via WebDAV, it is good to consider if this is a file that has been transferred to offline tape storage before. 

You can check this by navigating to the project collection in the MDR - Access data - Projects and check the contents of the Download column. If it states "Bring online" (see screenshot) then the file is stored offline on tape. 

You should first bring the file back online before you can download it. This can be done by either clicking "Bring online" for individual files or "Bring collection online" for the entire collection.

Detailed instructions can be found in the User manual Tape storage SURFsara.


HTTP 500 error in browser


HTTP 500 error in Cyberduck


MDR - Access data - Projects - Collection screen