CorvallisRecruiter Since 2001
the smart solution for Corvallis jobs

Hadoop Database Administrator

Company: HP
Location: Corvallis
Posted on: February 24, 2021

Job Description:

Locations: Corvallis, ORSan Diego, CA
HP PageWide Press is looking for an experienced Hadoop database administrator to join our Big Data, Analytics, and Applications team. You will be maintaining a database that ingests tens of gigabytes daily and provides an essential service for our department. Our team hosts the database at the Corvallis site, so you will be collaborating with our systems administrator to maintain and improve storage and hardware solutions. You will also be responsible for backup and recovery and user management. Our team and HP also provide the opportunity to grow your knowledge and experience in a variety of directions. The team is responsible for a wide variety of technical areas. If interested, there are opportunities to train and work on the data pipeline (ETL), data modelling, DevOps (Kubernetes/Rancher, Ansible), and PL/SQL and Java programming if you are a great Hadoop DBA and have experience with or interests in some of the other areas mentioned, then apply to join us!
We are located in Corvallis, Oregon. Currently, during COVID, the majority of the team works from home, but you may be required on-site if you have hardware maintenance experience and want to be responsible for or the alternate on hardware and systems administration.
ResponsibilitiesDuties and tasks needed:

  • Responsible for maintaining the integrity and performance of the Hadoop database Cluster called BackOffice
  • Must meet the internal SLA's that data is stored securely and optimally
  • Manage Hadoop database users, permissions, and resource constraints
  • Ensuring the security of HP data
  • Responsible for the evaluation of database software purchases
  • Responsible for evaluation of vendor services
  • The typical responsibilities of a Hadoop admin include - deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tool Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running Hadoop jobs.
  • Implementing, managing and administering the overall Hadoop infrastructure.
  • Takes care of the day-to-day running of Hadoop clusters
  • A Hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
  • Have a working knowledge of Cloudera Distribution the Hadoop admins will setup on startup the Hadoop configure.
  • Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
  • Hadoop admin is also responsible for deciding the size of the Hadoop cluster based on the data to be stored in HDFS.
  • Ensure that the Hadoop cluster is up and running all the time.
  • Monitoring the cluster connectivity and performance.
  • Manage and review Hadoop log files.
  • Backup and recovery tasks
  • Resource and security management
  • Troubleshooting application errors and ensuring that they do not occur again.
    Database Administrator Skills & Competencies:
    • Cloudera Manager features that make managing your clusters easier, such as aggregated logging, configuration management, resource management, reports, alerts, and service management
    • Configuring and deploying production-scale clusters that provide key Hadoop-related services, including YARN, HDFS, Impala, Hive, Spark, Kudu, and Kafka
    • Determining the correct hardware and infrastructure for your cluster
    • Proper cluster configuration and deployment to integrate with the data center
    • Ingesting, storing, and accessing data in HDFS, Kudu, and cloud object stores such as Amazon S3
    • How to load file-based and streaming data into the cluster using Kafka and Flume
    • Configuring automatic resource management to ensure service-level agreements are met for multiple users of a cluster
    • Best practices for preparing, tuning, and maintaining a production cluster
    • Troubleshooting, diagnosing, and solving cluster issues
    • PostgreSQL skills
    • Storage - 3PAR, FC, multipath
    • Linux and basic scripting skills.
      Knowledge & SkillsAnalytical skills: You must monitor the Hadoop database for performance from a variety of sources.Communication skills: In this position, the person will work in a team environment and effectively communicate with managers, developers, and other workers.Detail-oriented: Working with a database requires you to understand complex systems and how a minor error can cause significant problems.Problem-solving skills: When problems come up, administrators must troubleshoot them and resolve the issues
      • PostgreSQL skills
      • Storage - 3PAR, FC, multipath
      • Cloudera data warehouse (Hive, Impala). For future
      • Linux and basic scripting skills.
      • Strong analytical and problem solving skills.
      • Excellent written and verbal communication skills; mastery in English and local language. Ability to effectively communicate product architectures, design proposals and negotiate options at management levels.
        Scope & Impact
        • Collaborates with peers, junior engineers, data scientists and project team.
        • Typically interacts with high-level Individual Contributors, Managers and Program Teams.
        • Leads a project requiring data engineering solutions development.
          ---Education & Experience
          • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering or equivalent.
          • Typically 4-6 years' experience.

Keywords: HP, Corvallis , Hadoop Database Administrator, IT / Software / Systems , Corvallis, Oregon

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other IT / Software / Systems Jobs

.Net Lead Developer - REMOTE
Description: OverviewPerficient currently has a career opportunity for a .Net Lead Developer in our Commerce Practice located in Milwaukee WI, Allentown PA, or remote markets. This candidate will be the primary developer (more...)
Company: Perficient
Location: Portland
Posted on: 03/3/2021

Software Development Engineer in Test
Description: If you are a Software Development Engineer in Test with experience, please read on Based in downtown Portland, OR, we are a highly innovative AI-powered SaaS company focused on building out a one-one-a-kind (more...)
Company: Optello
Location: Portland
Posted on: 03/3/2021

Senior Software Engineer (Content)
Description: About The Job br br The Senior Software Engineer Content is a detail-oriented, UX-obsessed frontend/fullstack engineer that has the capability and drive to create beautiful and easy to use web applications (more...)
Company: Opal
Location: Portland
Posted on: 03/3/2021

Mortgage Loan Closer / Work Mobile
Description: Certified Mobile Notary Service is seeking someone to fill the position of a Mortgage Loan Closer to work remotely in the U.S. PRIMARY RESPONSIBILITIES: Reviews/prepares (more...)
Company: Certified Mobile Notary Service
Location: Portland
Posted on: 03/3/2021

Software Developer II
Description: At Logical Position, we're on a mission to help businesses grow. With over a dozen locations across the U.S., we're one of the fastest growing digital marketing agencies in the country. And we love what (more...)
Company: Logical Position
Location: Lake Oswego
Posted on: 03/3/2021

Senior Software Developer (React / Redux)
Description: We are a team of software innovators who love the challenge of crafting tools for physicians and hospitals.--With a unique user interface and an expert back-end, we transform the most complex medical (more...)
Company: ZHealth Documentation
Location: Portland
Posted on: 03/3/2021

SAP Security Lead - SISW - EDA - 240406
Description: ul li Wilsonville, United States of America Cincinnati, United States of America li Information Technology li 240406 Job Description Company: SISW -EDA-- br Job Title: SAP Security Lead - (more...)
Company: Siemens AG
Location: Wilsonville
Posted on: 03/3/2021

Magento Developer
Description: Looking for an experienced Magento web developer with 3 years of Magento experience. The right person is passionate about
Company: Altius Search Group
Location: Portland
Posted on: 03/3/2021

Senior Software Engineer - Platform
Description: About UsPeople Data Labs is focused on democratizing access to world class business information. We empower developers to create innovative, compliant data products at scale. We're building clean, consumable (more...)
Company: People Data Labs
Location: Portland
Posted on: 03/3/2021

Field Service Electronics Technician
Description: Eaton's Power Quality division is seeking a Field Service Electronics Technician to join our team of world-class customer service professionals. This position is based in the greater Portland, OR area. (more...)
Company: Eaton
Location: Wilsonville
Posted on: 03/3/2021

Log In or Create An Account

Get the latest Oregon jobs by following @recnetOR on Twitter!

Corvallis RSS job feeds