Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func GetInstaPostsScraperConfig ¶
func GetInstaPostsScraperConfig() (*ReaderConfig, *WriterConfig, *WriterConfig)
GetInstaPostsScraperConfig is a convenience function for gathering the necessary kafka configuration for the insta posts golang scrapers
func GetScraperConfig ¶
func GetScraperConfig() (*ReaderConfig, *WriterConfig, *WriterConfig)
GetScraperConfig is a convenience function for gathering the necessary kafka configuration for all golang scrapers
func NewReader ¶
func NewReader(c *ReaderConfig) *kafka.Reader
NewReader creates a kafka-go Reader structure by using common configuration and additionally applying the ReaderConfig on it
func NewWriter ¶
func NewWriter(c *WriterConfig) *kafka.Writer
NewWriter creates a kafka-go Writer structure by using common configurations and additionally applying the WriterConfig on it
Types ¶
type ReaderConfig ¶
ReaderConfig is an internal helper structure for creating a new pre-configurated kafka-go Reader
func GetInserterConfig ¶
func GetInserterConfig() *ReaderConfig
GetInserterConfig returns the Reader topics from kafka for Inserters
func NewReaderConfig ¶
func NewReaderConfig(kafkaAddress, groupID, topic string) *ReaderConfig
NewReaderConfig creates a new ReaderConfig structure
type WriterConfig ¶
WriterConfig is an internal helper structure for creating a new pre-configurated kafka-go Writer
func NewWriterConfig ¶
func NewWriterConfig(kafkaAddress, topic string, async bool) *WriterConfig
NewWriterConfig creates a new WriterConfig structure
Source Files
Directories