Data science/Database(28)
-
Understanding Oracle SE and DBMS
Understanding Oracle SE and DBMS In today's digital age, maintaining and analyzing data is more crucial than ever. One of the ways that businesses can keep up with the demand is by using Oracle SE and DBMS to create and access databases. Oracle SE and DBMS allow users to create and connect an instance using SQLPLUS. This blog post will discuss the steps to create and access databases, machine le..
2023.03.26 -
Understanding database - NoSQL ํ ์ฅ์ผ๋ก ์ด์ ๋ฆฌ
NoSQL ์ Not only SQL, Non-SQL์ ์ค ๋ง์ด๋ค. ๋ค์ํ ์ข ๋ฅ์ NoSQL์ด ์์ผ๋ฉฐ ๋ด๊ฐ ์ฌ๊ธฐ์ ์ฃผ๋ก ๋ค๋ฃจ๊ฒ ๋ ๋ด์ฉ์ MongoDB์ด๋ฉฐ ์ด๋ Document-based NoSQL์ ํด๋น๋๋ค. ๊ฐ ๋ชฉ์ ์ ๋ฐ๋ผ ๋ค์ํ ํด๋ค์ด ์์ผ๋ฉฐ ๊ธฐ๋ณธ์ ์ธ ๊ฐ๋ ์ ๋ํ ๋ถ๋ถ์ ๋น์ทํ๋ค๊ณ ์๊ฐ๋๋ค. ๋ฌผ๋ก ํด๋น ํด์ ์ ๋๋ก ๋ค๋ฃจ๋ ค๋ฉด ๋ง์ด ์ฝ๊ณ ๋ง์ด ๋ค๋ค๋ด์ผ ํ๋ ๋ฐ ์ฌ์ค ๋ชจ๋ ํด์ (๋ฐ์ดํฐ ๋ฒ ์ด์ค๋ง ๊ฐ์ง๊ณ ๋ ๊ฒ๋ ์๋ ์ํฉ์) ๋ค ๋ค๋ค๋ณด๋ ๊ฑด ์ฝ์ง ์์ ๊ฑฐ ๊ฐ๋ค. ํ๋์ ์ธ์ด๋ฅผ ์ ํํด์ ํ๊ณ ๋ค์ด๋ณด๋ ๊ฒ ํด๋น ๊ฐ๋ ์ ์ตํ๋ ๋ฐ ํฐ ๋์์ด ๋๋ค. ์ค์ ๋ก ํ๋ก์ ํธ๋ฅผ ํ๋ ์งํํด๋ณด๊ณ ๋์ ๋ค์ ๊ฐ์ ๋ด์ฉ์ ์ฝ์ด๋ดค์ ๋ ๋ ๊น์ด ๊ทธ๋ฆฌ๊ณ ๋๊ฒ ๋ด์ฉ์ดํด๊ฐ ๊ฐ๋ฅํ๋ค๋ ๋์ ๊ฒฝํ๋ด. Key-Value based NoSQ..
2023.01.23 -
Understanding Database - SQL ๊ธฐ์ด ์ด์ ๋ฆฌ
SQL vs NoSQL SQL์ ํ ์ด๋ธ ํ์, NoSQL์ ์ ํํ๋์ง ์์ ๋ฐ์ดํฐ๋ฒ ์ด์ค ํ์. SQL์ ๊ธฐ๋ณธ ๊ฐ๋ ์ธ ํ ์ด๋ธ, ๊ด๊ณ์ ๊ฐ๋ ์ NoSQL์์๋ ์ฝ๋ ์ , ๊ทธ๋ฆฌ๊ณ ์ฐธ์กฐ ํน์ ๋ด์ฅํ์ ๊ฐ๋ ์ ๋๋ก ์๊ฐํ ์ ์๊ฒ ๋ค. SQL์ ์ ํํ๋์ด ์์ด์ ๋จธ๋ฆฟ์์ ์ฌ์ค ๊ตฌ๋๋ฅผ ๊ทธ๋ฆฌ๋ ๊ฒ์ด ์๋์ ์ผ๋ก ํธํ๋ค. ๋ฐ๋ฉด, NoSQL์ ๊ตฌ์กฐ๊ฐ ์ ํํ๋์ด ์์ง ์์์ ๋จธ๋ฆฟ์์ ๊ตฌ์กฐ๋ฅผ ๋ช ํํ๊ฒ ๊ทธ๋ฆฌ๊ธฐ๊ฐ ์ฒ์์ ์ฝ์ง ์๋ค. ํ์ง๋ง ๊ทธ๋ก ์ธํ ์ฅ์ ์ ํ์ฅ์ฑ์ ์๋ค๊ณ ํ ์ ์๊ฒ ๋ค. ์๋ฅผ ๋ค์ด SQL์์๋ ๋ฐ์ดํฐ๋ฅผ ์ ํด์ง ํ ์ด๋ธ์ ํํ ์์ ๋ฃ์ด์ผ๋ง ํ์ง๋ง NoSQL์์๋ ๊ทธ๋ฐ ๋ถ๋ถ์ ์ ์ฝ์กฐ๊ฑด์ผ๋ก ์ถ๊ฐํ๊ฑฐ๋ ํน์ ์ ์ฝ ์กฐ๊ฑด ์์ด ๋ค์ํ ํํ์ ๋ฐ์ดํฐ๋ฅผ ํ๋์ ์ฝ๋ ์ (SQL๋ก ์น๋ฉด ํ๋์ ํ ์ด๋ธ)์ ๋ชฝ๋ ๊ทธ๋ฆฌ ์ ์ฅํ ์ ์๋ค๋ ์ฅ..
2023.01.23 -
Understanding Database 11 - Database Programming Techniques
Database Application system # 3-Tier Architecture Client: GUI, Web interface, display of info [i.e. HTML, CSS, JS] Application server or Web server: Application programs, web pages - stores biz rules, implement logic [i.e. divided by NodeJS, Python, Java, PHP, C; host language + SQL, NoSQL; Data sub-language] Database server: Database Management System - hosts DBMS (accept and process queries an..
2023.01.16 -
Understanding Database 10 - Data modelling with MongoDB
Modelling for RDBMS 1. Define schema 2. develop the application and DB queries -> One correct solution, no revision/Data duplicates /Usage makes schema demoralised(Performace dropping) Modelling for MongoDB 1. Develop and define the data model 2. re-define data model 3. Improve the application 4. improve the data model 5. repeat cycle 3 and 4 -> Multiple design options/design for usage patterns/..
2023.01.16 -
Understanding Database 9 - Distributed Database Systems(DDB)
Data Systems : combines different data storage technologies : caches, indexes and data in sync with application code : API(application programming interface) to hide architectural complexity : There are three ways to deal with requests in this figure, 1. In-memory cache 2. Primary database 3. Full-text index Before checking DB, check the cache to see if the data is cached. If there is no cache, ..
2023.01.16 -
Understanding Database 8 - NoSQL + Python Basic
PyMongo MongoDB Client-side JSON(Python) Python App, PyMongo Driver NoSQL BSON(MongoDB) Install and Use PyMonggo + DNSPython(to connect MongoDB Atlas) python -m pip install pymongo python -m pip install dnspython import pymongo from pymongo import MongoClient conn_str="mongodb+srv"://:@.mongodb.net/myFristDatabase" client = MongoClient(conn_str, serverSelectionTimeoutMs=5000) try: print(client.s..
2023.01.16 -
Understanding database 7 - NoSQL
NoSQL (Not only SQL, Non-SQL) Categories of NoSQL Systems Key-Value based NoSQL: Riak, Redis, Scalaris, Amazon DynamoDB Document-based NoSQL: MongoDB, CouchDB, OrientDB Column-base NoSQL: Google BigTable, Cassandra, Hbase, Amazon DynamoDB, Graph-based NoSQL: Neo4J, InfoGrid, FlockDB ACID Principle: RDBMS Gold Standard! Atomicity: Transactions are completely done or not done at all. Consistency: ..
2023.01.16 -
Understanding database 6 - Normalization
A systematic analysis of a schema to Eliminate redundancy Eliminate data modification problems Simplify queries on the DB possibly) improve efficiency Problems with INSERTING - If there are columns which doesn't include data: You have to fill them up with NULL, which is not recommended. (waste of memory and inefficient) Problems with UPDATING - If the one of value needs to be updated: If that va..
2023.01.15 -
Understanding Database 5 - Advanced SQL Queries (Stored Procedure, Trigger, Views)
Stored Procedure : Define your commands to run several queries by calling one procedure. You can use the conditional command, and it allows you to run the queries depending on what you get. The statement starts with DELIMITER / and finishes with DELIMITER ; Trigger This allows the DBMS to run some query every time a certain query runs. For instance, if you want to update the record of visiting, ..
2023.01.15