새소식

반응형
AI/[부트캠프] 데이터 사이언티스트 과정

[Megabyte School : AI 데이터 사이언티스트 취업 완성 과정] Day 59.

  • -
728x90
반응형

 

 

안녕하세요 늑대양입니다.

 

 

모델링 프로젝트를 2주간 진행합니다 🥸

 

 

오늘은 [AI 데이터 사이언티스트 취업 완성 과정]의 59일차 일과를 정리하여 안내해드리도록 하겠습니다.

 

 

 

 

늑대양 기본 버전!!

 

 

 

 

 

Day 59 시간표:

  • 미니 프로젝트: 모델링
  • 번외) 개발환경 설정 변경

 

 

 

미니 프로젝트: 모델링

 

 

 

 

 

 

 

 

번외) 개발환경 설정 변경

 

ANACONDA

 

 

 

기존의 miniforge 환경에서 prophet이 돌아가지 않는 현상이 발생하여 (매우 화가나서) 환경 재설정 테스트를 진행..🔥

 

GitHub - conda-forge/miniforge: A conda-forge distribution.

A conda-forge distribution. Contribute to conda-forge/miniforge development by creating an account on GitHub.

github.com

 

GitHub - facebook/prophet: Tool for producing high quality forecasts for time series data that has multiple seasonality with lin

Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth. - GitHub - facebook/prophet: Tool for producing high quality forecasts...

github.com

 

 

 

 

conda 시리즈 간의 관계, source: https://towardsdatascience.com/managing-project-specific-environments-with-conda-b8b50aa8be0e

 

 

 

 

 

진행 과정:

  1. 기존 mini-forge (쿨하게) 삭제
  2. 정식 anaconda 설치 (설치 링크: https://www.anaconda.com/products/distribution)
  3. conda env 구성 (하단 명령어 참고)
  4. 필요한 패키지 설치 진행 (하단 명령어 참고)
 

Anaconda | Anaconda Distribution

Anaconda's open-source Distribution is the easiest way to perform Python/R data science and machine learning on a single machine.

www.anaconda.com

 

 

 

Conclusion First!!

  • 원하던 패키지 구동 성공!! (prophet)
  • 코랩은 정답을 알고 있다?!

 

 

#################
# 버전 확인
#################

# 설치된 콘다 버전 확인
$ conda --version
> conda 22.9.0

# 로컬 파이썬 버전 확인
$ python --version
> Python 3.9.13		# 로컬 파이썬 버전은 3.9.13



#################
# 콘다 환경 구성
#################

## 콘다 환경 생성
#$ conda create -n sainthm python=3	 # 쿨하게 옵션 없이 최신버전으로 올려버림, 기존에는 3.8 사용
#> (base)

$ conda create -n sainthm python=3.7	# colab 버전과 최대한 동일하게 맞춰보기 # colab에서는 3.7.15 사용


# 콘다 환경 적용
$ conda activate sainthm
> (sainthm)

## 콘다 환경에 대한 버전 확인
#$ python --version (sainthm)
#> Python 3.11.0		# 당연히 쿨하게 최신으로 올라가짐

# 콘다 환경에 대한 버전 확인
$ python --version (sainthm)
> Python 3.7.12

################################
# 버전 업데이트 진행	# 필요시 진행
################################
#
#$ pip install --upgrade pip
#
#$ conda update -n base conda
#
#$ conda update --all




#################
# 필요한 패키지 설치
#################

# 기존 설치 리스트 확인
conda list
# packages in environment at /Users/sainthm/opt/anaconda3/envs/sainthm:
#
# Name                    Version                   Build  Channel
ca-certificates           2022.9.24            h033912b_0    conda-forge
libcxx                    14.0.6               hccf4f1f_0    conda-forge
libffi                    3.4.2                h0d85af4_5    conda-forge
libsqlite                 3.39.4               ha978bb4_0    conda-forge
libzlib                   1.2.13               hfd90126_4    conda-forge
ncurses                   6.3                  h96cf925_1    conda-forge
openssl                   3.0.7                hfd90126_0    conda-forge
pip                       22.3.1             pyhd8ed1ab_0    conda-forge
python                    3.7.12        hf3644f1_100_cpython conda-forge
readline                  8.1.2                h3899abd_0    conda-forge
setuptools                65.5.1             pyhd8ed1ab_0    conda-forge
sqlite                    3.39.4               h9ae0607_0    conda-forge
tk                        8.6.12               h5dbffcc_0    conda-forge
wheel                     0.38.4             pyhd8ed1ab_0    conda-forge
xz                        5.2.6                h775f41a_0    conda-forge


# 설치 진행
$ conda install numpy pandas matplotlib scikit-learn seaborn jupyter prophet




# 설치된 패키지 확인

$ conda list
# packages in environment at /Users/sainthm/opt/anaconda3/envs/sainthm:
#
# Name                    Version                   Build  Channel
anyio                     3.6.2              pyhd8ed1ab_0    conda-forge
appnope                   0.1.3              pyhd8ed1ab_0    conda-forge
argon2-cffi               21.3.0             pyhd8ed1ab_0    conda-forge
argon2-cffi-bindings      21.2.0           py37h69ee0a8_2    conda-forge
attrs                     22.1.0             pyh71513ae_1    conda-forge
backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
backports                 1.0                        py_2    conda-forge
backports.functools_lru_cache 1.6.4          pyhd8ed1ab_0    conda-forge
beautifulsoup4            4.11.1             pyha770c72_0    conda-forge
bleach                    5.0.1              pyhd8ed1ab_0    conda-forge
brotli                    1.0.9                hb7f2c08_8    conda-forge
brotli-bin                1.0.9                hb7f2c08_8    conda-forge
bzip2                     1.0.8                h0d85af4_4    conda-forge
ca-certificates           2022.9.24            h033912b_0    conda-forge
cctools_osx-64            973.0.1             h3eff9a4_10    conda-forge
certifi                   2022.9.24          pyhd8ed1ab_0    conda-forge
cffi                      1.15.1           py37h7346b73_1    conda-forge
clang                     13.0.1               h694c41f_0    conda-forge
clang-13                  13.0.1       default_he082bbe_0    conda-forge
clang_osx-64              13.0.1               h71a8856_3    conda-forge
clangxx                   13.0.1       default_he082bbe_0    conda-forge
clangxx_osx-64            13.0.1               heae0f87_3    conda-forge
cmdstan                   2.29.2               hd546b82_2    conda-forge
cmdstanpy                 1.0.8              pyhd8ed1ab_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
compiler-rt               13.0.1               he01351e_0    conda-forge
compiler-rt_osx-64        13.0.1               hd3f61c9_0    conda-forge
convertdate               2.4.0              pyhd8ed1ab_0    conda-forge
cycler                    0.11.0             pyhd8ed1ab_0    conda-forge
dbus                      1.13.6               h811a1a6_3    conda-forge
debugpy                   1.6.3            py37hf6dfe07_0    conda-forge
decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
defusedxml                0.7.1              pyhd8ed1ab_0    conda-forge
entrypoints               0.4                pyhd8ed1ab_0    conda-forge
ephem                     4.1.3            py37h8052db5_4    conda-forge
expat                     2.5.0                hf0c8a7f_0    conda-forge
flit-core                 3.8.0              pyhd8ed1ab_0    conda-forge
fonttools                 4.38.0           py37h8052db5_0    conda-forge
freetype                  2.12.1               h3f81eb7_0    conda-forge
gettext                   0.21.1               h8a4c099_0    conda-forge
hijri-converter           2.2.4              pyhd8ed1ab_0    conda-forge
holidays                  0.17               pyhd8ed1ab_0    conda-forge
icu                       69.1                 he49afe7_0    conda-forge
idna                      3.4                pyhd8ed1ab_0    conda-forge
importlib-metadata        4.11.4           py37hf985489_0    conda-forge
importlib_resources       5.10.0             pyhd8ed1ab_0    conda-forge
ipykernel                 6.16.2             pyh736e0ef_0    conda-forge
ipython                   7.33.0           py37hf985489_0    conda-forge
ipython_genutils          0.2.0                      py_1    conda-forge
ipywidgets                8.0.2              pyhd8ed1ab_1    conda-forge
jedi                      0.18.1             pyhd8ed1ab_2    conda-forge
jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
joblib                    1.2.0              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   hac89ed1_2    conda-forge
jsonschema                4.17.0             pyhd8ed1ab_0    conda-forge
jupyter                   1.0.0            py37hf985489_7    conda-forge
jupyter_client            7.4.6              pyhd8ed1ab_0    conda-forge
jupyter_console           6.4.4              pyhd8ed1ab_0    conda-forge
jupyter_core              4.11.1           py37hf985489_0    conda-forge
jupyter_server            1.23.2             pyhd8ed1ab_0    conda-forge
jupyterlab_pygments       0.2.2              pyhd8ed1ab_0    conda-forge
jupyterlab_widgets        3.0.3              pyhd8ed1ab_0    conda-forge
kiwisolver                1.4.4            py37h229a17a_0    conda-forge
korean_lunar_calendar     0.3.1              pyhd8ed1ab_0    conda-forge
krb5                      1.19.3               hb98e516_0    conda-forge
lcms2                     2.14                 h90f4b2a_0    conda-forge
ld64_osx-64               609                 h6fbe7a8_10    conda-forge
lerc                      4.0.0                hb486fe8_0    conda-forge
libblas                   3.9.0         16_osx64_openblas    conda-forge
libbrotlicommon           1.0.9                hb7f2c08_8    conda-forge
libbrotlidec              1.0.9                hb7f2c08_8    conda-forge
libbrotlienc              1.0.9                hb7f2c08_8    conda-forge
libcblas                  3.9.0         16_osx64_openblas    conda-forge
libclang                  13.0.1       default_he082bbe_0    conda-forge
libclang-cpp13            13.0.1       default_he082bbe_0    conda-forge
libcxx                    14.0.6               hccf4f1f_0    conda-forge
libdeflate                1.14                 hb7f2c08_0    conda-forge
libedit                   3.1.20191231         h0678c8f_2    conda-forge
libffi                    3.4.2                h0d85af4_5    conda-forge
libgfortran               5.0.0         9_5_0_h97931a8_26    conda-forge
libgfortran5              11.3.0              h082f757_26    conda-forge
libglib                   2.74.1               h4c723e1_1    conda-forge
libiconv                  1.17                 hac89ed1_0    conda-forge
liblapack                 3.9.0         16_osx64_openblas    conda-forge
libllvm13                 13.0.1               h64f94b2_2    conda-forge
libopenblas               0.3.21        openmp_h429af6e_3    conda-forge
libpng                    1.6.38               ha978bb4_0    conda-forge
libpq                     14.5                 hd79e848_1    conda-forge
libsodium                 1.0.18               hbcb3906_1    conda-forge
libsqlite                 3.39.4               ha978bb4_0    conda-forge
libtiff                   4.4.0                hdb44e8a_4    conda-forge
libwebp-base              1.2.4                h775f41a_0    conda-forge
libxcb                    1.13              h0d85af4_1004    conda-forge
libzlib                   1.2.13               hfd90126_4    conda-forge
llvm-openmp               15.0.4               h61d9ccf_0    conda-forge
llvm-tools                13.0.1               h64f94b2_2    conda-forge
lunarcalendar             0.0.9                      py_0    conda-forge
make                      4.3                  h22f3db7_1    conda-forge
markupsafe                2.1.1            py37h69ee0a8_1    conda-forge
matplotlib                3.5.3            py37hf985489_2    conda-forge
matplotlib-base           3.5.3            py37h3748cd6_2    conda-forge
matplotlib-inline         0.1.6              pyhd8ed1ab_0    conda-forge
mistune                   2.0.4              pyhd8ed1ab_0    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
mysql-common              8.0.31               hc4b2c72_0    conda-forge
mysql-libs                8.0.31               h8658499_0    conda-forge
nbclassic                 0.4.8              pyhd8ed1ab_0    conda-forge
nbclient                  0.7.0              pyhd8ed1ab_0    conda-forge
nbconvert                 7.2.5              pyhd8ed1ab_0    conda-forge
nbconvert-core            7.2.5              pyhd8ed1ab_0    conda-forge
nbconvert-pandoc          7.2.5              pyhd8ed1ab_0    conda-forge
nbformat                  5.7.0              pyhd8ed1ab_0    conda-forge
ncurses                   6.3                  h96cf925_1    conda-forge
nest-asyncio              1.5.6              pyhd8ed1ab_0    conda-forge
notebook                  6.5.2              pyha770c72_1    conda-forge
notebook-shim             0.2.2              pyhd8ed1ab_0    conda-forge
nspr                      4.32                 hcd9eead_1    conda-forge
nss                       3.78                 ha8197d3_0    conda-forge
numpy                     1.21.6           py37h345d48f_0    conda-forge
openjpeg                  2.5.0                h5d0d7b0_1    conda-forge
openssl                   3.0.7                hfd90126_0    conda-forge
packaging                 21.3               pyhd8ed1ab_0    conda-forge
pandas                    1.3.5            py37h5b83a90_0    conda-forge
pandoc                    2.19.2               h694c41f_1    conda-forge
pandocfilters             1.5.0              pyhd8ed1ab_0    conda-forge
parso                     0.8.3              pyhd8ed1ab_0    conda-forge
patsy                     0.5.3              pyhd8ed1ab_0    conda-forge
pcre2                     10.40                h1c4e4bc_0    conda-forge
pexpect                   4.8.0              pyh1a96a4e_2    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
pillow                    9.2.0            py37ha6ba2b9_2    conda-forge
pip                       22.3.1             pyhd8ed1ab_0    conda-forge
pkgutil-resolve-name      1.3.10             pyhd8ed1ab_0    conda-forge
prometheus_client         0.15.0             pyhd8ed1ab_0    conda-forge
prompt-toolkit            3.0.32             pyha770c72_0    conda-forge
prompt_toolkit            3.0.32               hd8ed1ab_0    conda-forge
prophet                   1.1.1            py37hf985489_1    conda-forge
psutil                    5.9.3            py37h8052db5_0    conda-forge
pthread-stubs             0.4               hc929b4f_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pygments                  2.13.0             pyhd8ed1ab_0    conda-forge
pymeeus                   0.5.10             pyhd8ed1ab_0    conda-forge
pyparsing                 3.0.9              pyhd8ed1ab_0    conda-forge
pyqt                      5.12.3           py37h25ebb8a_4    conda-forge
pyqt5-sip                 4.19.18                  pypi_0    pypi
pyqtchart                 5.12                     pypi_0    pypi
pyqtwebengine             5.12.1                   pypi_0    pypi
pyrsistent                0.18.1           py37h69ee0a8_1    conda-forge
python                    3.7.12     hf3644f1_100_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python-fastjsonschema     2.16.2             pyhd8ed1ab_0    conda-forge
python_abi                3.7                     2_cp37m    conda-forge
pytz                      2022.6             pyhd8ed1ab_0    conda-forge
pyzmq                     24.0.1           py37haa7bc41_0    conda-forge
qt                        5.12.9               h2a607e2_5    conda-forge
qtconsole                 5.4.0              pyhd8ed1ab_0    conda-forge
qtconsole-base            5.4.0              pyha770c72_0    conda-forge
qtpy                      2.3.0              pyhd8ed1ab_0    conda-forge
readline                  8.1.2                h3899abd_0    conda-forge
scikit-learn              1.0.2            py37h572704e_0    conda-forge
scipy                     1.7.3            py37h4e3cf02_0    conda-forge
seaborn                   0.12.1               hd8ed1ab_0    conda-forge
seaborn-base              0.12.1             pyhd8ed1ab_0    conda-forge
send2trash                1.8.0              pyhd8ed1ab_0    conda-forge
setuptools                59.8.0           py37hf985489_1    conda-forge
setuptools-git            1.2                        py_1    conda-forge
sigtool                   0.1.3                h88f4db0_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sniffio                   1.3.0              pyhd8ed1ab_0    conda-forge
soupsieve                 2.3.2.post1        pyhd8ed1ab_0    conda-forge
sqlite                    3.39.4               h9ae0607_0    conda-forge
statsmodels               0.13.2           py37h4de8ad1_0    conda-forge
tapi                      1100.0.11            h9ce4665_0    conda-forge
tbb                       2021.6.0             hb8565cd_1    conda-forge
tbb-devel                 2021.6.0             hb8565cd_1    conda-forge
terminado                 0.17.0             pyhd1c38e8_0    conda-forge
threadpoolctl             3.1.0              pyh8a188c0_0    conda-forge
tinycss2                  1.2.1              pyhd8ed1ab_0    conda-forge
tk                        8.6.12               h5dbffcc_0    conda-forge
tornado                   6.2              py37h994c40b_0    conda-forge
tqdm                      4.64.1             pyhd8ed1ab_0    conda-forge
traitlets                 5.5.0              pyhd8ed1ab_0    conda-forge
typing-extensions         4.4.0                hd8ed1ab_0    conda-forge
typing_extensions         4.4.0              pyha770c72_0    conda-forge
unicodedata2              14.0.0           py37h69ee0a8_1    conda-forge
wcwidth                   0.2.5              pyh9f0ad1d_2    conda-forge
webencodings              0.5.1                      py_1    conda-forge
websocket-client          1.4.2              pyhd8ed1ab_0    conda-forge
wheel                     0.38.4             pyhd8ed1ab_0    conda-forge
widgetsnbextension        4.0.3              pyhd8ed1ab_0    conda-forge
xorg-libxau               1.0.9                h35c211d_0    conda-forge
xorg-libxdmcp             1.1.3                h35c211d_0    conda-forge
xz                        5.2.6                h775f41a_0    conda-forge
zeromq                    4.3.4                he49afe7_1    conda-forge
zipp                      3.10.0             pyhd8ed1ab_0    conda-forge
zstd                      1.5.2                hfa58983_4    conda-forge




########################################
# 필요한 추가 패키지 설치	# 계속 추가 예정
########################################

$ conda install pyarrow lightgbm # xgboost

$ brew install libomp

$ conda install -c conda-forge py-xgboost plotly

# 2022.11.30 추가
$ conda install -c conda-forge tensorflow

 

 

 

 

 

 

 

 

 

긴 글 읽어주셔서 감사합니다 🫠

 

 

 

 

 

 

728x90
반응형
Contents

포스팅 주소를 복사했습니다

이 글이 도움이 되었다면 공감 부탁드립니다.