Semantic Search Engineer

“We are looking for Semantic Search Developers for crawling and feeding data into search engines. Should have worked with Apache Solr, Pipeship, AWS, Data Specilist, ML and MS Graph”

1. Data Acquisition

• Use Apache ManifoldCF to crawl SharePoint, file systems, or databases.

• Use Microsoft Graph API for structured Microsoft 365 data.

2. Semantic Enrichment

• Use Apache Marmotta to enrich data with RDF triples and linked data.

3. Pipeline Orchestration

• Use Pipeship to manage ingestion, enrichment, and indexing workflows.

4. Indexing & Search

• Push enriched data into Apache Solr or AWS OpenSearch.

• Use custom analyzers and faceting for semantic search.

5. Cloud Infrastructure

• Host components on AWS EC2/EKS, store data in S3, and monitor with CloudWatch.