What will next boom in Database technology.

Hello,

Data means meaningful information. This data generated from various sources. Some data can be structured  data and unstructured. Structured data like bank data with row and columns in defined format (Table format). Unstructured data is like http log , log4j log - which also called streaming data.

Structured  data is mainly managed by traditional way of RDBMS e.g. Oracle, MsSQL, Sybase, DB2 etc. Even it can managed by NoSQL e.g. MongoDB, Cassandra and HBase (These are nosql database/next generation database).

Stream data or Unstructured data to manage we have Apache Spark, is very useful.

So data will accumulated every days, not just from banking,  IT companies , social networking sites, it also generate from manufacturing companies also. After AI and IOT (Internet Of Things), it generates from tiny sensor as well. So Data is growing, expectation are by 2020 data would 44ZB (44 trillion gigabytes).  Every 2 years data is doubling in size.

So we need lot of storage along with technologies to process all these mammoth of data.  So we have Big Data technology open source like Apache Hadoop.

So Hadoop is next Boom in Market.. or Any other Big Data Technology.

Hadoop ecosystem has various solution for different requirements.

HBase  - is the Hadoop database, a distributed, scalable, big data store. When you need random, real time read/write access.

Hive   - Hadoop data-warehouse, processing large data sets. Developed by Facebook. Nosql, Columnar DB (column Store DB - Derby DB). Its like Cassandra db.

Spark  - Processing Streaming data and real time analysis. ,With built-in modules for streaming, SQL, machine learning and graph processing.

Kafka  - Messaging solution.

Pig    - A procedural (data flow )language for processing semi-strutured data-sets using Hadoop Map reduce Developed by- Yahoo.

Sqoop  - Data loading tool from RDBMS (SQL to Hadoop)

Flume  - Streaming data -> e.g. https log, for click data, non structured one. 

Oozie  - Workflow , Job Scheduler
Zoo keeper - Coordinator.

There are many Hadoop flavor in the market you can explore more....

Typical DBA's Day to Day Activities

Typically Oracle DBA performs below activities. List can more lengthy, just wanted to give overview to understand.

• Data guard, ASM, RAC configuration, troubleshoot and support.
• Golden gate setup in bidirectional and unidirectional replication.
• Database cloning, DG setup, PIT recovery using RMAN.
• Fine Tuning of Production Queries to boost data retrieval.
• Creating databases (including setting parameters, distribution of datafiles etc.)
• Managing all Daily database maintenance issues.
• Devised backup and recovery strategy for this 24 x 7 availability.
• Oracle 9i, 10g, 11g, 12c installation on Linux, Aix, Window, Cloud (aws.amazon.com) Environment.
• Deploying backup (hot and cold) mechanisms and recovery procedures.
• Loading data between databases (Export and Import, SQL Loader).
• Tuning Oracle Instance using STATSPACK (before 10g), OEM, ADDM, ASH and AWR Utility.
• Improving performance by creating appropriate indexes - This is App DBA specific
• Oracle database replication using stream - Old way for replication.
• Managing growth of the database tables, compacting and free space reclamation.
• Scheduling jobs queues - This is App DBA specific
• Developing various Database Monitoring Scripts.
• Creating materialized views for reporting applications - This is App DBA specific
• Creating Partition table, external organized table for report - This is App DBA specific
• Creating system and schema triggers for monitoring data objects handling and security and DML triggers for implementing complex business requirements.
• Implementing security policy and profile.
• Solving connectivity issues and networking problems.
• Writing shell scripts for OS level maintenance of Oracle database.
• Periodic Maintenance and up gradation of Applications as per the requirements.
• Developing functions/procedures, Triggers and packages (PL/SQL).

   And Many more its upto individual how much interest he shows accepting challenges. In Oracle each tools can go foremost deep level. Its contnuous learning and exploring............