Skip to content

DARC Blog

Editing Files on the Command Line

When working within JupyterHub, one can utilize the built-in Text Editor to directly edit scripts on the Yens. However, it is sometimes more convenient and faster to edit files directly from the command line, for instance if you are logged into a terminal and need to make small changes to your Slurm script prior to submission.

In this post, we will illustrate how you can do this using the Vim text editor that comes with Linux distributions and can be used on any HPC system or server. As a specific example, we will make small changes to a Python script from the command line.

  • in zip
  • 2 min read

How Do I Extract Compressed Files?

Compressed files are commonly used to save storage space and simplify file transfers, especially when dealing with large datasets or collections of files. Knowing how to uncompress these files is essential for quick and efficient access to your data. This guide will walk you through the process of uncompressing files on the Yens, covering several common compression formats. By following the examples below, you'll be able to handle compressed files effectively, whether for transfer or long-term storage.

SEC Filings

All companies are required to file registration statements, periodic reports, and other forms to the SEC and these filings are popular sources of data for researchers at the GSB. This post covers some of the resources available to facilitate research using these filings and a few sample workflows.

Installing Software On The Yen Servers

As a yen user, you can install your own custom software in your home directory or any location where you have permissions (such as a shared project space). If you are working with other researchers on a shared project, it is a good idea to have a dedicated shared software directory where you can install required software.

  • in zip
  • 4 min read

Working with Large Zip Files in Python

How to work with large zip files without unzipping them

Problem

You need to access data from a zip file, but you don’t want to copy the zip file to your home/project directory and unzip it. How can you access this data efficiently?

Here is an example of a directory containing zip files and other files. It includes two notebooks, a sample zip file, and its unzipped contents stored in the zipcontents folder.