Haystack

pip install haystack-ai mcp python-dotenv

{
  "route_used": "/twitter/advanced_search",
  "query": "AI agents",
  "has_more": true,
  "next_cursor": "cursor_123",
  "tweets": [
    {
      "tweet_id": "1803006263529541838",
      "author_username": "openai",
      "created_at": "2026-07-02T10:00:00Z",
      "text": "Example tweet text"
    }
  ]
}

from haystack import Document


def tweets_to_documents(handoff: dict) -> list[Document]:
    return [
        Document(
            content=row["text"],
            meta={
                "tweet_id": row["tweet_id"],
                "author_username": row.get("author_username"),
                "created_at": row.get("created_at"),
                "route_used": handoff.get("route_used"),
                "query": handoff.get("query"),
                "next_cursor": handoff.get("next_cursor"),
            },
        )
        for row in handoff["tweets"]
    ]

Use Twexapi MCP to search recent X posts about "haystack ai".
Call explore first. Return JSON with route_used, query, has_more, next_cursor, and tweets.
Each tweet must include tweet_id, author_username, created_at, text, public_url, and engagement metrics.
Do not call write endpoints.

Use Twexapi MCP to fetch recent timeline posts from @openai.
Return JSON with route_used, username, user_id if available, has_more, next_cursor, and tweets.
Each tweet must include tweet_id, full_text or text, created_at, and author fields.

checkpoint = {
    "route_used": handoff["route_used"],
    "query": handoff.get("query"),
    "has_more": handoff.get("has_more", False),
    "next_cursor": handoff.get("next_cursor"),
}

Use Twexapi MCP to search recent posts about "AI agents".
Return compact JSON with route_used, query, has_more, next_cursor, and tweets.
Each tweet must include tweet_id, author_username, created_at, and text.
Do not call write endpoints.

async def collect_documents(agent) -> list[Document]:
    handoff = await agent.run("Collect recent posts about AI agents as strict JSON.")
    return tweets_to_documents(handoff)