{ "cells": [ { "cell_type": "markdown", "id": "2460ee47", "metadata": {}, "source": [ "# Preprocessing\n", "\n", "This notebook demonstrates how to preprocess astronomical images using the `ezphot` library. Preprocessing is a crucial step in astronomical data reduction that involves:\n", "\n", "- **Bias correction**: Removing electronic bias from CCD detectors\n", "- **Dark current correction**: Subtracting thermal noise from long exposures \n", "- **Flat field correction**: Correcting for pixel-to-pixel sensitivity variations\n", "\n", "We'll walk through the complete workflow from data loading to final corrected images." ] }, { "cell_type": "markdown", "id": "ac6e1c2c", "metadata": {}, "source": [ "## 1. Load Data\n", "\n", "The first step in preprocessing is to load your astronomical data. We'll use two main approaches:\n", "\n", "- **`DataBrowser`**: Query and filter images from your local data directory\n", "- **`SDTDataQuerier`**: Sync data from a central database (optional but recommended for large datasets)\n", "\n", "> **💡 Tip**: The `SDTDataQuerier` class provides methods to sync data from a central database to your local workspace, making it easy to work with large astronomical datasets without storing everything locally." ] }, { "cell_type": "markdown", "id": "8780f941", "metadata": {}, "source": [ "### 1.1. Sync Data with SDTDataQuerier (Optional)\n", "\n", "If you have access to a central database, you can sync specific observations to your local workspace. This is particularly useful when working with large datasets or when you only need specific observations.\n" ] }, { "cell_type": "code", "execution_count": null, "id": "1f2660dc", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Help for SDTDataQuerier\n", "\n", "\n", "Public methods:\n", "- show_obsdestdata(foldername: str, show_only_numbers: bool = False, pattern: str = '*.fits')\n", "- show_obsdestfolder(folder_key: str = '*')\n", "- show_obssourcedata(foldername: str, show_only_numbers: bool = False, pattern: str = '*.fits')\n", "- show_obssourcefolder(folder_key: str = '*')\n", "- show_scidestdata(targetname: str, show_only_numbers: bool = False, key: str = 'filter', pattern: str = '*.fits')\n", "- show_scisourcedata(targetname: str, show_only_numbers: bool = False, key: str = 'filter', file_pattern: str = '*.fits')\n", "- show_scisourcefolder(folder_key: str = '*')\n", "- sync_obsdata(foldername: str, file_pattern: str = '*.fits', ignore_exists: bool = True)\n", "- sync_scidata(targetname: str, file_pattern: str = '*.fits', ignore_exists: bool = True)\n" ] } ], "source": [ "from ezphot.utils import SDTDataQuerier\n", "# If you connected the database, you can easily sync the data from the database. \n", "sdtquery = SDTDataQuerier()\n", "sdtquery.help()" ] }, { "cell_type": "markdown", "id": "b76e19ae", "metadata": {}, "source": [ "Now let's sync the data for our specific observation date. We'll use the `sync_obsdata` method to copy FITS files matching our pattern:\n" ] }, { "cell_type": "code", "execution_count": 8, "id": "8c671146", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Source directory: /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata\n", "Target directory: /home/hhchoi1022/ezphot/data/obsdata/7DT\n", "Running:Running:Running:Running:Running:Running:Running:Running:Running:Running:Running: rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT07/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/ rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT10/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT01/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT14/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT12/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT08/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT16/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/\n", "rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT06/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT11/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/\n", "rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT03/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/rsync -av --info=progress2 --no-inc-recursive --prune-empty-dirs --ignore-existing --include */ --include *T00290*.fits --exclude * /home/hhchoi1022/ezphot/data/connecteddata/7DT/obsdata/7DT13/2025-09-05_gain2750/ /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... building file list ... done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)\n", "\n", "sent 350 bytes received 12 bytes 241.33 bytes/sec\n", "total size is 734,123,520 speedup is 2,027,965.52\n", "done\n", "\n", "\n", "sent 341 bytes received 12 bytes 235.33 bytes/sec\n", "total size is 734,123,520 speedup is 2,079,670.03\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)\n", "\n", "sent 358 bytes received 12 bytes 246.67 bytes/sec\n", "total size is 734,123,520 speedup is 1,984,117.62\n", "done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)done\n", " 0 0% 0.00kB/s 0:00:00 (xfr#0, to-chk=0/7)\n", "\n", "sent 361 bytes received 12 bytes 248.67 bytes/sec\n", "total size is 734,123,520 speedup is 1,968,159.57\n", "\n", "\n", "sent 360 bytes received 12 bytes 248.00 bytes/sec\n", "total size is 734,123,520 speedup is 1,973,450.32\n", "\n", "\n", "sent 359 bytes received 12 bytes 247.33 bytes/sec\n", "total size is 734,123,520 speedup is 1,978,769.60\n", "\n", "\n", "sent 359 bytes received 12 bytes 247.33 bytes/sec\n", "total size is 734,123,520 speedup is 1,978,769.60\n", "\n", "\n", "sent 358 bytes received 12 bytes 246.67 bytes/sec\n", "total size is 734,123,520 speedup is 1,984,117.62\n", "\n", "\n", "sent 358 bytes received 12 bytes 246.67 bytes/sec\n", "total size is 734,123,520 speedup is 1,984,117.62\n", "\n", "\n", "sent 361 bytes received 12 bytes 248.67 bytes/sec\n", "total size is 734,123,520 speedup is 1,968,159.57\n", "\n", "\n", "sent 357 bytes received 12 bytes 246.00 bytes/sec\n", "total size is 734,123,520 speedup is 1,989,494.63\n" ] } ], "source": [ "# sync_scidata method will run multiple rsync between Science Source directory and destination directory.\n", "print('Source directory:', sdtquery.helper.config['SDTDATA_OBSSOURCEDIR'])\n", "print('Target directory:', sdtquery.helper.config['SDTDATA_OBSDESTDIR'])\n", "obsdate_name = '2025-09-05_gain2750'\n", "sdtquery.sync_obsdata(foldername = obsdate_name, file_pattern = '*T00290*.fits')" ] }, { "cell_type": "markdown", "id": "e3e1d9b3", "metadata": {}, "source": [ "> **🔄 Sync Progress**: The rsync process copies FITS files from the source directory to your local destination directory. This ensures you have the latest data while maintaining efficient storage usage.\n" ] }, { "cell_type": "markdown", "id": "fe37b7e0", "metadata": {}, "source": [ "### 🔎 1.2. Query Data with DataBrowser\n", "\n", "The `DataBrowser` class allows us to query and filter our synced data. Here we'll explore the available keys and their values to understand what data we have access to.\n", "\n", "**Key Features:**\n", "- Filter by observatory, telescope, object name, filter, image type, and observation date\n", "- Load data as `ScienceImage` objects or metadata tables\n", "- Flexible search patterns for file matching\n" ] }, { "cell_type": "code", "execution_count": 11, "id": "940c7d32", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "[INFO] Found 66 files matching '/home/hhchoi1022/ezphot/data/obsdata/*/*/2025-09-05_gain2750/*.fits'\n" ] }, { "data": { "text/plain": [ "['/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_233955_T00290_m700_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234653_T00290_m725_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234508_T00290_m725_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234838_T00290_m725_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234140_T00290_m700_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_233809_T00290_m700_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_233808_T00290_m450_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234653_T00290_m475_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234508_T00290_m475_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_233954_T00290_m450_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234839_T00290_m475_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234139_T00290_m450_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_234549_T00290_m575_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_234923_T00290_m575_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_233828_T00290_m550_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_234736_T00290_m575_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_234015_T00290_m550_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750/7DT06_20250905_234202_T00290_m550_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_233955_T00290_m875_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_234653_T00290_m400_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_234508_T00290_m400_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_234838_T00290_m400_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_234140_T00290_m875_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750/7DT13_20250905_233810_T00290_m875_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_234837_T00290_m875_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_233955_T00290_m850_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_234140_T00290_m850_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_234652_T00290_m875_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_233810_T00290_m850_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750/7DT12_20250905_234506_T00290_m875_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_234158_T00290_m800_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_234724_T00290_m825_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_233824_T00290_m800_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_234011_T00290_m800_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_234911_T00290_m825_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750/7DT10_20250905_234537_T00290_m825_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_234511_T00290_m525_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_234656_T00290_m525_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_233957_T00290_m650_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_233811_T00290_m650_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_234142_T00290_m650_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750/7DT07_20250905_234841_T00290_m525_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_234516_T00290_r_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_233815_T00290_g_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_234145_T00290_g_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_234702_T00290_r_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_234000_T00290_g_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750/7DT16_20250905_234846_T00290_r_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_234157_T00290_i_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_234730_T00290_m675_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_234918_T00290_m675_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_234010_T00290_i_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_233822_T00290_i_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750/7DT01_20250905_234542_T00290_m675_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234014_T00290_m600_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234551_T00290_m500_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234202_T00290_m600_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234928_T00290_m500_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_233825_T00290_m600_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234739_T00290_m500_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234002_T00290_m625_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_233817_T00290_m625_1x1_100.0s_0000.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234659_T00290_m425_1x1_100.0s_0001.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234147_T00290_m625_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234843_T00290_m425_1x1_100.0s_0002.fits',\n", " '/home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234513_T00290_m425_1x1_100.0s_0000.fits']" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from ezphot.utils import DataBrowser\n", "dbrowser = DataBrowser('obsdata')\n", "dbrowser.obsdate = obsdate_name\n", "dbrowser.search('*.fits', return_type = 'path')" ] }, { "cell_type": "code", "execution_count": 12, "id": "b6464a08", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "[INFO] Found 66 files matching '/home/hhchoi1022/ezphot/data/obsdata/*/*/2025-09-05_gain2750/*.fits'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "Loading Science Images: 100%|██████████| 66/66 [00:01<00:00, 51.40it/s]" ] }, { "name": "stdout", "output_type": "stream", "text": [ "[INFO] Found 66 files matching '/home/hhchoi1022/ezphot/data/obsdata/*/*/2025-09-05_gain2750/*.fits'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT07/2025-09-05_gain2750Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750\n", "\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT01/2025-09-05_gain2750Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT12/2025-09-05_gain2750\n", "\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT10/2025-09-05_gain2750\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT06/2025-09-05_gain2750Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750\n", "\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT16/2025-09-05_gain2750\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750\n", "Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750Loaded 6 FITS files from /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT13/2025-09-05_gain2750\n", "\n", "Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6Total FITS files combined: 6\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "Collecting ImgInfo: 100%|██████████| 11/11 [00:00<00:00, 33240.16it/s]\n" ] } ], "source": [ "# If you wish to get the ScienceImage object, \n", "target_imgset = dbrowser.search('*.fits', return_type = 'science')\n", "target_imglist = target_imgset.target_images\n", "# If you wish to get the metadata table from the keys, \n", "metadata_table = dbrowser.search('*.fits', return_type = 'imginfo')" ] }, { "cell_type": "code", "execution_count": 13, "id": "1bb3db2e", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
| file | altitude | azimuth | ccd-temp | gain | filter | imgtype | exptime | obsdate | locdate | jd | mjd | binning | object | objctid | obsmode | specmode | note | telescop |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| str121 | str32 | str32 | str32 | str21 | str4 | str5 | str32 | str23 | str23 | str32 | str32 | str21 | str6 | str32 | str4 | str7 | str4 | str5 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_233955_T00290_m700_1x1_100.0s_0001.fits | 39.837596 | 179.72268 | -10.0 | 2750 | m700 | LIGHT | 100.0 | 2025-09-05T23:39:55.000 | 2025-09-05 19:39:55.000 | 2460924.486053241 | 60923.98605324074 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234653_T00290_m725_1x1_100.0s_0001.fits | 39.840043 | 180.091172 | -10.0 | 2750 | m725 | LIGHT | 100.0 | 2025-09-05T23:46:53.000 | 2025-09-05 19:46:53.000 | 2460924.4908912037 | 60923.990891203706 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234508_T00290_m725_1x1_100.0s_0000.fits | 39.840357 | 179.998559 | -9.8 | 2750 | m725 | LIGHT | 100.0 | 2025-09-05T23:45:08.000 | 2025-09-05 19:45:08.000 | 2460924.489675926 | 60923.98967592593 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234838_T00290_m725_1x1_100.0s_0002.fits | 39.83912 | 180.183768 | -10.0 | 2750 | m725 | LIGHT | 100.0 | 2025-09-05T23:48:38.000 | 2025-09-05 19:48:38.000 | 2460924.4921064815 | 60923.992106481484 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_234140_T00290_m700_1x1_100.0s_0002.fits | 39.839148 | 179.815416 | -10.1 | 2750 | m700 | LIGHT | 100.0 | 2025-09-05T23:41:40.000 | 2025-09-05 19:41:40.000 | 2460924.4872685187 | 60923.98726851852 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT08/2025-09-05_gain2750/7DT08_20250905_233809_T00290_m700_1x1_100.0s_0000.fits | 39.83547 | 179.629828 | -9.8 | 2750 | m700 | LIGHT | 100.0 | 2025-09-05T23:38:09.000 | 2025-09-05 19:38:09.000 | 2460924.484826389 | 60923.984826388885 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT08 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_233808_T00290_m450_1x1_100.0s_0000.fits | 39.820706 | 179.644698 | -10.1 | 2750 | m450 | LIGHT | 100.0 | 2025-09-05T23:38:08.000 | 2025-09-05 19:38:08.000 | 2460924.4848148148 | 60923.984814814816 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT03 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234653_T00290_m475_1x1_100.0s_0001.fits | 39.82478 | 180.107488 | -10.0 | 2750 | m475 | LIGHT | 100.0 | 2025-09-05T23:46:53.000 | 2025-09-05 19:46:53.000 | 2460924.4908912037 | 60923.990891203706 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT03 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT03/2025-09-05_gain2750/7DT03_20250905_234508_T00290_m475_1x1_100.0s_0000.fits | 39.825207 | 180.014533 | -10.0 | 2750 | m475 | LIGHT | 100.0 | 2025-09-05T23:45:08.000 | 2025-09-05 19:45:08.000 | 2460924.489675926 | 60923.98967592593 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT03 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234202_T00290_m600_1x1_100.0s_0002.fits | 39.823601 | 179.853116 | -10.0 | 2750 | m600 | LIGHT | 100.0 | 2025-09-05T23:42:02.000 | 2025-09-05 19:42:02.000 | 2460924.4875231483 | 60923.98752314815 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT14 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234928_T00290_m500_1x1_100.0s_0002.fits | 39.822232 | 180.246067 | -10.1 | 2750 | m500 | LIGHT | 100.0 | 2025-09-05T23:49:28.000 | 2025-09-05 19:49:28.000 | 2460924.4926851853 | 60923.992685185185 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT14 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_233825_T00290_m600_1x1_100.0s_0000.fits | 39.820335 | 179.662379 | -9.9 | 2750 | m600 | LIGHT | 100.0 | 2025-09-05T23:38:25.000 | 2025-09-05 19:38:25.000 | 2460924.485011574 | 60923.98501157408 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT14 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT14/2025-09-05_gain2750/7DT14_20250905_234739_T00290_m500_1x1_100.0s_0001.fits | 39.823586 | 180.150701 | -9.9 | 2750 | m500 | LIGHT | 100.0 | 2025-09-05T23:47:39.000 | 2025-09-05 19:47:39.000 | 2460924.491423611 | 60923.991423611114 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT14 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234002_T00290_m625_1x1_100.0s_0001.fits | 39.82206 | 179.744821 | -9.9 | 2750 | m625 | LIGHT | 100.0 | 2025-09-05T23:40:02.000 | 2025-09-05 19:40:02.000 | 2460924.486134259 | 60923.986134259256 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_233817_T00290_m625_1x1_100.0s_0000.fits | 39.820108 | 179.652273 | -10.1 | 2750 | m625 | LIGHT | 100.0 | 2025-09-05T23:38:17.000 | 2025-09-05 19:38:17.000 | 2460924.4849189813 | 60923.984918981485 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234659_T00290_m425_1x1_100.0s_0001.fits | 39.823944 | 180.11177 | -10.1 | 2750 | m425 | LIGHT | 100.0 | 2025-09-05T23:46:59.000 | 2025-09-05 19:46:59.000 | 2460924.4909606483 | 60923.990960648145 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234147_T00290_m625_1x1_100.0s_0002.fits | 39.823463 | 179.837513 | -10.1 | 2750 | m625 | LIGHT | 100.0 | 2025-09-05T23:41:47.000 | 2025-09-05 19:41:47.000 | 2460924.487349537 | 60923.987349537034 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234843_T00290_m425_1x1_100.0s_0002.fits | 39.822916 | 180.20439 | -9.9 | 2750 | m425 | LIGHT | 100.0 | 2025-09-05T23:48:43.000 | 2025-09-05 19:48:43.000 | 2460924.492164352 | 60923.992164351854 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |
| /home/hhchoi1022/ezphot/data/obsdata/7DT/7DT11/2025-09-05_gain2750/7DT11_20250905_234513_T00290_m425_1x1_100.0s_0000.fits | 39.824364 | 180.019297 | -9.9 | 2750 | m425 | LIGHT | 100.0 | 2025-09-05T23:45:13.000 | 2025-09-05 19:45:13.000 | 2460924.489733796 | 60923.9897337963 | 1 | T00290 | 9473692bf1874a48a7492f0f1ad94624 | Spec | specall | None | 7DT11 |