怎么在python3中連接kafka模塊?針對(duì)這個(gè)問(wèn)題,這篇文章詳細(xì)介紹了相對(duì)應(yīng)的分析和解答,希望可以幫助更多想解決這個(gè)問(wèn)題的小伙伴找到更簡(jiǎn)單易行的方法。
1.1安裝模塊
pip install pykafka
1.2基本使用
# -* coding:utf8 *- from pykafka import KafkaClient host = 'IP:9092, IP:9092, IP:9092' client = KafkaClient(hosts = host) # 生產(chǎn)者 topicdocu = client.topics['my-topic'] producer = topicdocu.get_producer() for i in range(100): print i producer.produce('test message ' + str(i ** 2)) producer.stop()
1.3簡(jiǎn)單封裝
class KafkaProduct(): def __init__(self,hosts,topic): """ 初始化實(shí)例 :param hosts: 連接地址 :param topic: """ self.__client = KafkaClient(hosts=hosts) self.__topic = self.__client.topics[topic.encode()] def __set_topic(self, topic): self.__topic = self.__client.topics[topic.encode()] def set_topic(self, topic): """ 設(shè)置topic :param topic: :return: """ self.__set_topic(topic) def get_topics(self): """ 獲取當(dāng)前所有topic :return: """ return self.__client.topics def get_topic(self): """ 獲取當(dāng)前topic :return: """ return self.__topic def Producer(self): """ 生產(chǎn)者對(duì)象 :return: """ with self.__topic.get_producer(delivery_reports=True) as producer: next_data = '' while True: if next_data: producer.produce(str(next_data).encode()) next_data = yield True def send_data(self,datas): """ 發(fā)送數(shù)據(jù) :param datas:需要傳入的可迭代對(duì)象 :return: """ c = self.Producer() next(c) for i in datas: c.send(i) if __name__ == '__main__': hosts = "1.2.3.4:9999,2.3.4.5:9090" #連接hosts topic = "test_523" K = KafkaProduct(hosts=hosts, topic=topic) # #K.set_topic("test") #切換設(shè)置新的topic K.get_topic() #獲取當(dāng)前設(shè)置的topic #K.get_topics() #獲取所有topic data = range(10000) #要發(fā)送的可迭代對(duì)象 K.send_data(data)
關(guān)于怎么在python3中連接kafka模塊問(wèn)題的解答就分享到這里了,希望以上內(nèi)容可以對(duì)大家有一定的幫助,如果你還有很多疑惑沒有解開,可以關(guān)注創(chuàng)新互聯(lián)行業(yè)資訊頻道了解更多相關(guān)知識(shí)。
當(dāng)前文章:怎么在python3中連接kafka模塊-創(chuàng)新互聯(lián)
分享地址:http://aaarwkj.com/article6/ihoog.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián),為您提供電子商務(wù)、動(dòng)態(tài)網(wǎng)站、標(biāo)簽優(yōu)化、外貿(mào)網(wǎng)站建設(shè)、定制網(wǎng)站、面包屑導(dǎo)航
聲明:本網(wǎng)站發(fā)布的內(nèi)容(圖片、視頻和文字)以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主,如果涉及侵權(quán)請(qǐng)盡快告知,我們將會(huì)在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng),如需處理請(qǐng)聯(lián)系客服。電話:028-86922220;郵箱:631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載,或轉(zhuǎn)載時(shí)需注明來(lái)源: 創(chuàng)新互聯(lián)
猜你還喜歡下面的內(nèi)容