5

Go Task Scheduler with Distributed Lock

3 years ago

source link: https://dev.to/ehsaniara/go-task-scheduler-with-distributed-lock-4am1
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

neoserver,ios ssh client

Cover image for Go Task Scheduler with Distributed Lock

Go Task Scheduler with Distributed Lock

Aug 1

・2 min read

Golang Interval job timer, with distributed Lock

goInterLock is golang job/task scheduler with distributed locking mechanism. In distributed system locking is prevent task been executed in every instant that has the scheduler, For example, if your application has a task of calling some external APIs or doing some DB querying every 10 minutes, the lock prevents the process been run in every instance of that application and you ended up running that task multiple time every 10 minutes.

Quick Start

go get github.com/ehsaniara/gointerlock

Enter fullscreen modeExit fullscreen mode

Local Scheduler (Single App)

(Interval every 2 seconds)

var job = gointerlock.GoInterval{
    Interval: 2 * time.Second,
    Arg:      myJob,
}
err := job.Run(ctx)
if err != nil {
        log.Fatalf("Error: %s", err)
}

Enter fullscreen modeExit fullscreen mode

Distributed Scheduler (Scaled Up)

Existing Redis Connection

you should already configure your Redis connection and pass it into the GoInterLock. Also make sure you are giving the
unique name per job

Step 1: configure redis connection redisConnection.Rdb from the existing application and pass it into the Job. for example:

var redisConnector = redis.NewClient(&redis.Options{
    Addr:     "localhost:6379",
    Password: "myRedisPassword", 
    DB:       0,               
})

Enter fullscreen modeExit fullscreen mode

Step 2: Pass the redis connection into the GoInterval

var job = gointerlock.GoInterval{
    Interval: 2 * time.Second,
    Arg:      myJob,
    Name:     "MyTestJob",
    RedisConnector: redisConnector,
}
err := jobTicker.Run(ctx)
if err != nil {
    log.Fatalf("Error: %s", err)
}

Enter fullscreen modeExit fullscreen mode

in both examples myJob is your function, for example:

func myJob() {
    fmt.Println(time.Now(), " - called")
}

Enter fullscreen modeExit fullscreen mode

Note: currently GoInterLock does not support any argument for the job function

Built in Redis Connector

another way is to use an existing redis connection:

var job = gointerlock.GoInterval{
    Name:          "MyTestJob",
    Interval:      2 * time.Second,
    Arg:           myJob,
    RedisHost:     "localhost:6379",
    RedisPassword: "myRedisPassword", //remove this line if no pass (AUTH)
}
err := job.Run(context.Background())
if err != nil {
    log.Fatalf("Error: %s", err)
}

Enter fullscreen modeExit fullscreen mode

GoInterLock is using go-redis for Redis Connection.

Recommend

About Joyk

Aggregate valuable and interesting links.
Joyk means Joy of geeK