Application Performance Management (APM)

https://naver.github.io/pinpoint/

https://www.dynatrace.com/

Advertisements

Kerberos

Kerberos is a protocol for authenticating service requests between trusted hosts across an untrusted network, such as the internet. … The three heads of the Kerberos protocol represent a client, a server and a Key Distribution Center (KDC), which acts as Kerberos’ trusted third-party authentication service.

https://en.wikipedia.org/wiki/Kerberos_(protocol)

https://searchsecurity.techtarget.com/definition/Kerberos

-o-

Handling Millions of Files

Reading / Querying
https://prestodb.io/docs/current/
Commercial Support for Presto: https://www.starburstdata.com/presto-support/

Presto HIVE connector to read files: https://prestodb.io/docs/current/connector/hive.html#supported-file-types

Presto Tutorial: https://www.tutorialspoint.com/apache_presto/index.htm

Reading / Writing
MinIO: https://www.minio.io/
MinIO Distributed
https://github.com/minio/minio/tree/master/docs/distributed

Presto/MinIO/Hive Configuration
https://blog.minio.io/presto-modern-interactive-sql-query-engine-for-enterprise-ce56d7aea931

Presto Performance and AWS Cost Matrix
https://www.concurrencylabs.com/blog/starburst-presto-vs-aws-redshift/

Comparison with LLAP/Presto/Tez
https://www.datanami.com/2017/06/22/hadoop-engines-compete-comcast-query-smackdown/

A curated list of MinIO
https://github.com/minio/awesome-minio

Batch Framework

An Overview of Batch Processing in Java EE 7.0
https://www.oracle.com/technetwork/articles/java/batch-1965499.html

AWS Batch
https://docs.aws.amazon.com/batch/latest/userguide/job_definitions.html

Spring Batch
https://docs.spring.io/spring-batch/trunk/reference/htmlsingle/

JSR 352: Batch Applications for the Java Platform
https://www.jcp.org/en/jsr/detail?id=352

JSR 352 Spec: http://download.oracle.com/otn-pub/jcp/batch-1_0-fr-eval-spec/JSR-352-1.0-Final-Release.pdf

—-

https://en.wikipedia.org/wiki/Batch_processing

https://www.infoq.com/articles/batch-etl-streams-kafka

https://blog.westmonroepartners.com/10-best-practices-for-high-performance-etl-processing/

https://aws.amazon.com/blogs/big-data/top-8-best-practices-for-high-performance-etl-processing-using-amazon-redshift/

https://panoply.io/data-warehouse-guide/3-ways-to-build-an-etl-process/

https://codeburst.io/etl-processes-and-data-partitioning-approaches-6f461514c3d3
-0-