diff --git a/docs/aliases.md b/docs/aliases.md index 3b2dd8e..6aadcef 100644 --- a/docs/aliases.md +++ b/docs/aliases.md @@ -15,6 +15,8 @@ [DOWNLOADCYBERDUCK]: https://cyberduck.io/download/ "Download Cyberduck" +[TACCACLS]: https://docs.tacc.utexas.edu/tutorials/acls "Manage Permissions with Access Control Lists" +[TACCMANAGINGPERMISSIONS]: https://docs.tacc.utexas.edu/tutorials/permissions "Unix Group Permissions and Environment" [TACCLMOD]: https://lmod.readthedocs.io/en/latest/ "Lmod" [TACCREMOTEDESKTOPACCESS]: https://docs.tacc.utexas.edu/tutorials/remotedesktopaccess "TACC Remote Desktop Access" [TACCSHARINGPROJECTFILES]: https://docs.tacc.utexas.edu/tutorials/sharingprojectfiles "Sharing Project Files" diff --git a/docs/hpc/corral.md b/docs/hpc/corral.md index a7b45a9..7b18f78 100644 --- a/docs/hpc/corral.md +++ b/docs/hpc/corral.md @@ -1,5 +1,5 @@ # Corral User Guide -*Last update: July 26, 2023* +*Last update: October 14, 2024* ## System Overview { #overview } @@ -9,15 +9,6 @@ Corral is a collection of storage and data management resources located at TACC, PIs may request any quantity of storage across multiple allocations. The first 5TB of storage for each PI, on one project, is available to researchers at all UT System institutions at no cost. For storage needs larger than 5TB, and for multiple project allocations, access to Corral is available at a cost of $60/TB/year. There is also a limit of 200,000 files per allocated terabyte imposed on all Corral allocations - for example, if you are allocated 5TB of storage, you may store 1 million files within that 5TB, and if you need to store additional files you must request a larger allocation. This policy is subject to change, and users with long-term storage needs are encouraged to plan for the costs of storing their data in future years. - - - ### Consulting and Data Management Plans { #overview-plans } The Data Management and Collections group at TACC can provide specialized consulting services to help make the best use of Corral, either for existing projects or for planned research tasks. The group can also assist with developing data management plans for research that would incorporate the use of Corral and other TACC resources as part of research and data management workflows. For more information or to inquire about such consulting services, please contact us at . @@ -36,13 +27,13 @@ Consult the [S3 API](http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html The S3 interface is most suitable for programmatic interaction from within custom applications. We recommend the minio client for command-line access and testing purposes. Documentation and download links for the minio client are available at: . -Please direct any further questions you may have regarding the cloud storage interface to Corral through the [TACC ticket system][HELPDESK]. +Please direct any further questions you may have regarding the cloud storage interface to Corral through the [TACC ticket system][CREATETICKET]. ## System Access { #access } -Corral is available to researchers at all UT System campuses, including both academic and health institutions. Corral is intended to support research activities involving large quantities of data and/or complex data management requirements. There is no requirement that users have allocations on other TACC systems, and Corral can be utilized independently of TACC computational and visualization resources. +Corral is available to researchers at all UT System campuses, including both academic and health institutions. Corral is intended to support research activities involving large quantities of data and/or complex data management requirements. There is no requirement that users have allocations on other TACC systems, and Corral can be utilized independently of TACC computational and visualization resources. -You may request an allocation on Corral through the TACC User Portal. When requesting an allocation, indicate the quantity of storage you expect to utilize in terabytes, the nature of the research project that will be supported through the use of Corral, and the service or services you expect to utilize. It is also helpful if you provide a suggested name for the directory or a collection name under which your data will be stored on Corral. Once your allocation has been granted, you will receive an e-mail indicating the location of your data in the file system accessible from the Corral login/data movement nodes. +You may request an allocation on Corral through the TACC User Portal. When requesting an allocation, indicate the quantity of storage you expect to utilize in terabytes, the nature of the research project that will be supported through the use of Corral, and the service or services you expect to utilize. It is also helpful if you provide a suggested name for the directory or a collection name under which your data will be stored on Corral. Once your allocation has been granted, you will receive an e-mail indicating the location of your data in the file system accessible from the Corral login/data movement nodes. ### Basic File System Access from Lonestar6 and Other TACC systems { #access-external } @@ -79,7 +70,6 @@ Files on Corral are never "purged" using automated processes, however each alloc ## Transferring your Files to Corral { #transferring } -Data transfer mechanisms differ depending on whether you are using iRODS or basic file system access. For iRODS users, please see the [iRODS user guide](../../software/irods). Data transfer to and from the file system is described below. **For Secure data:** All the instructions for SCP and Cyberduck as shown below can be used for transferring data to a secure location on Corral, however please substitute the hostname `secure.corral.tacc.utexas.edu` for `data.tacc.utexas.edu`. You will be given access to this system when you are granted access to a secure Corral folder, and this system can be used exclusively for accessing your secure data area on Corral. Secure locations on Corral are not generally accessible from TACC data transfer and login nodes. @@ -87,19 +77,19 @@ Data transfer mechanisms differ depending on whether you are using iRODS or basi Data transfer from any Unix/Linux system can be accomplished using the `scp` utility to copy data to and from the login node. A file can be copied from your local system to the remote server using the command: -``` cmd-line +```cmd-line login1$ scp filename username@data.tacc.utexas.edu:/path/to/project/directory ``` Where *filename* is the path to the file on your local system, and the path is what was provided to you when your allocation was granted. While a whole directory can be copied recursively using the `-r` switch: -``` cmd-line +```cmd-line login1$ scp -r directory username@data.tacc.utexas.edu:/path/to/project/directory ``` Copying data from the Corral system to your local machine is similar, but reverse the order of the arguments: -``` cmd-line +```cmd-line login1$ scp username@data.tacc.utexas.edu:/path/to/project/directory/filename \ /path/to/local/directory ``` @@ -181,7 +171,7 @@ In this example, the `d` at the front indicates that this is a directory, and it ### Managing Files and Permissions using ACLs { #managing-acls } -For a more fine-grained approach to files and permissions, use **A**ccess **C**ontrol **L**ists or ACLs. With ACLS you can create customized groups of users with customized permissions. Please consult TACC's document "Manage Permissions with Access Control Lists" for detailed information. +For a more fine-grained approach to files and permissions, use **A**ccess **C**ontrol **L**ists or ACLs. With ACLS you can create customized groups of users with customized permissions. Please consult TACC's document [Manage Permissions with Access Control Lists][TACCACLS] for detailed information. ### Managing Permissions with `chmod` { #managing-chmod } @@ -216,7 +206,7 @@ This policy applies to both the main and "protected" areas of Corral4. * [Lonestar6 User Guide](../lonestar6) * [Cyberduck home page](http://cyberduck.io/) * [UNIX manual pages](https://www.freebsd.org/cgi/man.cgi) - +* [Unix Group Permissions and Environment][TACCMANAGINGPERMISSIONS] {%include 'aliases.md' %} diff --git a/docs/tutorials/permissions.md b/docs/tutorials/permissions.md index c59b251..2a292c2 100644 --- a/docs/tutorials/permissions.md +++ b/docs/tutorials/permissions.md @@ -1,4 +1,4 @@ -# Unix Group Permissions and controlling the current Group context +# Unix Group Permissions and Environment Last update: *October 14, 2024* @@ -78,6 +78,7 @@ Users who are members of multiple projects may have several groups associated wi * [Manage Permissions with Access Control Lists][TACCACLS] * [Sharing Project Files at TACC][TACCSHARINGPROJECTFILES] +* [TACC Corral User Guide](../../hpc/corral) {% include 'aliases.md' %}