Golang实现请求限流的几种办法(小结)

2020-01-28 13:59:37于丽

源码[url] ( https://github.com/golang/net/blob/master/netutil/listen.go ),基本思路就是为连接数计数,通过make chan来建立一个最大连接数的channel, 每次accept就+1,close时候就-1. 当到达最大连接数时,就等待空闲连接出来之后再accept。


// Copyright 2013 The Go Authors. All rights reserved.
// Use of this source code is governed by a BSD-style
// license that can be found in the LICENSE file.
 
// Package netutil provides network utility functions, complementing the more
// common ones in the net package.
package netutil // import "golang.org/x/net/netutil"
 
import (
  "net"
  "sync"
)
 
// LimitListener returns a Listener that accepts at most n simultaneous
// connections from the provided Listener.
func LimitListener(l net.Listener, n int) net.Listener {
  return &limitListener{
    Listener: l,
    sem:   make(chan struct{}, n),
    done:   make(chan struct{}),
  }
}
 
type limitListener struct {
  net.Listener
  sem    chan struct{}
  closeOnce sync.Once   // ensures the done chan is only closed once
  done   chan struct{} // no values sent; closed when Close is called
}
 
// acquire acquires the limiting semaphore. Returns true if successfully
// accquired, false if the listener is closed and the semaphore is not
// acquired.
func (l *limitListener) acquire() bool {
  select {
  case <-l.done:
    return false
  case l.sem <- struct{}{}:
    return true
  }
}
func (l *limitListener) release() { <-l.sem }
 
func (l *limitListener) Accept() (net.Conn, error) {
  //如果sem满了,就会阻塞在这
  acquired := l.acquire()
  // If the semaphore isn't acquired because the listener was closed, expect
  // that this call to accept won't block, but immediately return an error.
  c, err := l.Listener.Accept()
  if err != nil {
    if acquired {
      l.release()
    }
    return nil, err
  }
  return &limitListenerConn{Conn: c, release: l.release}, nil
}
 
func (l *limitListener) Close() error {
  err := l.Listener.Close()
  l.closeOnce.Do(func() { close(l.done) })
  return err
}
 
type limitListenerConn struct {
  net.Conn
  releaseOnce sync.Once
  release   func()
}
 
func (l *limitListenerConn) Close() error {
  err := l.Conn.Close()
  //close时释放占用的sem
  l.releaseOnce.Do(l.release)
  return err
}

使用Token Bucket(令牌桶算法)实现请求限流

在开发高并发系统时有三把利器用来保护系统:缓存、降级和限流!为了保证在业务高峰期,线上系统也能保证一定的弹性和稳定性,最有效的方案就是进行服务降级了,而限流就是降级系统最常采用的方案之一。

这里为大家推荐一个开源库 https://github.com/didip/tollbooth ,但是,如果您想要一些简单的、轻量级的或者只是想要学习的东西,实现自己的中间件来处理速率限制并不困难。今天我们就来聊聊如何实现自己的一个限流中间件

首先我们需要安装一个提供了 Token bucket (令牌桶算法)的依赖包,上面提到的toolbooth 的实现也是基于它实现的: