准备工作

首先拉取项目源码:

git clone https://github.com/HashZhang/spring-cloud-scaffold.git

打开其中的 spring-cloud-hoxton 项目。

  1. 启动Eureka
  2. 启动zone1-service-provider-instance1zone1-service-provider-instance2zone1-service-provider2-instance1zone2-service-provider-instance1这四个实例
  3. 启动service-consumer这个实例

整个集群如下图所示:

image

其中,zone1 的 service-provider 微服务的 instance-1 是有问题的实例(就是zone1-service-provider-instance1),某些接口会导致 readTimeOut 或者有异常抛出。 请参考项目源代码。

1. 基本Feign调用负载均衡与重试测试

service-consumer 的 testFeign 接口实现

@RequestMapping("/testFeign")
public void test() {
    Map<String, String> map = Map.of("time", System.currentTimeMillis() + "");
    try {
        log.info("testGet {}", serviceProviderTestFeignCleint.testGet(map));
        log.info("testGet {}", serviceProviderTestFeignCleint.testGet(map));
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testGet error: {}", e.getMessage());
    }
    try {
        log.info("testPost {}", serviceProviderTestFeignCleint.testPost(map));
        log.info("testPost {}", serviceProviderTestFeignCleint.testPost(map));
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testPost error: {}", e.getMessage());
    }
    try {
        log.info("testPut {}", serviceProviderTestFeignCleint.testPut(map));
        log.info("testPut {}", serviceProviderTestFeignCleint.testPut(map));
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testPut error: {}", e.getMessage());
    }
    try {
        log.info("testDelete {}", serviceProviderTestFeignCleint.testDelete(map));
        log.info("testDelete {}", serviceProviderTestFeignCleint.testDelete(map));
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testDelete error: {}", e.getMessage());
    }
    try {
        log.info("testTimeoutGet {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutGet());
        log.info("testTimeoutGet {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutGet());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testTimeoutGet error: {}", e.getMessage());
    }
    try {
        log.info("testTimeoutPost {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutPost());
        log.info("testTimeoutPost {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutPost());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testTimeoutPost error: {}", e.getMessage());
    }
    try {
        log.info("testTimeoutPut {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutPut());
        log.info("testTimeoutPut {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutPut());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testTimeoutPut error: {}", e.getMessage());
    }
    try {
        log.info("testTimeoutDelete {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutDelete());
        log.info("testTimeoutDelete {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutDelete());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testTimeoutDelete error: {}", e.getMessage());
    }
    try {
        log.info("testExceptionThrownGet {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownGet());
        log.info("testExceptionThrownGet {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownGet());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testExceptionThrownGet error: {}", e.getMessage());
    }
    try {
        log.info("testExceptionThrownPost {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownPost());
        log.info("testExceptionThrownPost {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownPost());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testExceptionThrownPost error: {}", e.getMessage());
    }
    try {
        log.info("testExceptionThrownPut {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownPut());
        log.info("testExceptionThrownPut {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownPut());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testExceptionThrownPut error: {}", e.getMessage());
    }
    try {
        log.info("testExceptionThrownDelete {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownDelete());
        log.info("testExceptionThrownDelete {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownDelete());
        TimeUnit.SECONDS.sleep(2);
    } catch (Exception e) {
        log.error("testExceptionThrownDelete error: {}", e.getMessage());
    }
}

调用两次是为了看负载均衡是否生效。通过日志查看结果:

2020-05-27 09:47:19.835  INFO
            [service-provider,5de10ccae7fe4636,c31f48a495e99b9d] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-simple
2020-05-27 09:47:19.880  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:28]:testGet zone1
2020-05-27 09:47:19.885  INFO
            [service-provider,5de10ccae7fe4636,7acbfd9804c09412] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-simple
2020-05-27 09:47:19.895  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:29]:testGet zone1
2020-05-27 09:47:21.903  INFO
            [service-provider,5de10ccae7fe4636,b606536590fdc82f] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8002/test-simple
2020-05-27 09:47:21.913  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:35]:testPost zone1
2020-05-27 09:47:21.920  INFO
            [service-provider,5de10ccae7fe4636,93c1084a06d7c674] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8001/test-simple
2020-05-27 09:47:21.930  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:36]:testPost zone1
2020-05-27 09:47:23.935  INFO
            [service-provider,5de10ccae7fe4636,fe6925d1021fd9f8] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8001/test-simple
2020-05-27 09:47:23.941  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:42]:testPut zone1
2020-05-27 09:47:23.946  INFO
            [service-provider,5de10ccae7fe4636,f61ed5b076dca92d] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8002/test-simple
2020-05-27 09:47:23.953  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:43]:testPut zone1
2020-05-27 09:47:25.956  INFO
            [service-provider,5de10ccae7fe4636,89a7ac048e6ddc0b] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-4][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8001/test-simple
2020-05-27 09:47:25.962  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:49]:testDelete zone1
2020-05-27 09:47:25.966  INFO
            [service-provider,5de10ccae7fe4636,7bd0bde77ef194e1] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-4][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8002/test-simple
2020-05-27 09:47:25.972  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:50]:testDelete zone1
2020-05-27 09:47:27.975  INFO
            [service-provider,5de10ccae7fe4636,cca178414a880ec1] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:28.992  INFO
            [service-provider,5de10ccae7fe4636,947b76400677ab80] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:29.002  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:56]:testTimeoutGet zone1
2020-05-27 09:47:29.006  INFO
            [service-provider,5de10ccae7fe4636,7e46a1671bea5301] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-6][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:30.022  INFO
            [service-provider,5de10ccae7fe4636,1e709bcecd91eb0a] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-6][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:30.027  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:57]:testTimeoutGet zone1
2020-05-27 09:47:32.032  INFO
            [service-provider,5de10ccae7fe4636,e17bbc1e3ce6029f] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-7][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:32.037  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:63]:testTimeoutPost zone1
2020-05-27 09:47:32.040  INFO
            [service-provider,5de10ccae7fe4636,b1de4a39edb5287c] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-7][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:33.047 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:67]:testTimeoutPost error: Read timed out
2020-05-27 09:47:33.050  INFO
            [service-provider,5de10ccae7fe4636,fdda69cb8f6a35df] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-8][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:33.054  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:70]:testTimeoutPut zone1
2020-05-27 09:47:33.059  INFO
            [service-provider,5de10ccae7fe4636,a065f86f497efeff] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-8][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:34.062 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:74]:testTimeoutPut error: Read timed out
2020-05-27 09:47:34.066  INFO
            [service-provider,5de10ccae7fe4636,3cf4c8e674ac65a5] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-9][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:34.070  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:77]:testTimeoutDelete zone1
2020-05-27 09:47:34.073  INFO
            [service-provider,5de10ccae7fe4636,ebc66e34f4764a4f] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-9][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:35.079 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:81]:testTimeoutDelete error: Read timed out
2020-05-27 09:47:35.083  INFO
            [service-provider,5de10ccae7fe4636,3231a4b1ca0b6d3f] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-10][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:35.088  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:84]:testExceptionThrownGet zone1
2020-05-27 09:47:35.098  INFO
            [service-provider,5de10ccae7fe4636,cca178414a880ec1] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:35.099  INFO
            [service-provider,5de10ccae7fe4636,18c0b280dbb66634] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:35.104  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:85]:testExceptionThrownGet zone1
2020-05-27 09:47:37.108  INFO
            [service-provider,5de10ccae7fe4636,ce121077557d9c59] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:37.117  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:91]:testExceptionThrownPost zone1
2020-05-27 09:47:37.119  INFO
            [service-provider,5de10ccae7fe4636,14213e88b6256cc4] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:37.130 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:95]:testExceptionThrownPost error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 09:47:37 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@282032be
2020-05-27 09:47:37.133  INFO
            [service-provider,5de10ccae7fe4636,ace6dad8af347b17] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:37.138  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:98]:testExceptionThrownPut zone1
2020-05-27 09:47:37.142  INFO
            [service-provider,5de10ccae7fe4636,6fc36f26cbc98139] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:37.151 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:102]:testExceptionThrownPut error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 09:47:37 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@1c0c1395
2020-05-27 09:47:37.154  INFO
            [service-provider,5de10ccae7fe4636,4493e16032542075] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-4][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:37.161  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:105]:testExceptionThrownDelete zone1
2020-05-27 09:47:37.163  INFO
            [service-provider,5de10ccae7fe4636,5f3f981a7e01b16d] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: DELETE -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:37.177 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:109]:testExceptionThrownDelete error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 09:47:37 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@735469a9

可以看出:

1.调用的都是 zone1 的两个实例。在 zone1 有实例的时候,调用的都是 zone1 的实例。

2.实例之间线程池隔离,例如下面这两行日志:

2020-05-27 08:00:07.835  INFO
            [service-provider,452ccc4ba7304c2c,5f56b4a90f40e5cd] [10276]
            [bulkhead-service-provider:192.168.0.142:8001-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-simple
2020-05-27 08:00:07.901  INFO
            [service-provider,452ccc4ba7304c2c,452ccc4ba7304c2c] [10276]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:28]:testGet zone1
2020-05-27 08:00:07.906  INFO
            [service-provider,452ccc4ba7304c2c,51e05504dafe88fc] [10276]
            [bulkhead-service-provider:192.168.0.142:8002-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-simple
2020-05-27 08:00:07.943  INFO
            [service-provider,452ccc4ba7304c2c,452ccc4ba7304c2c] [10276]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:29]:testGet zone1

调用192.168.0.142:8001这个实例的线程池是bulkhead-service-provider:192.168.0.142:8001-1,调用192.168.0.142:8002这个实例的线程是bulkhead-service-provider:192.168.0.142:8002-1。他们分别属于对应实例的resilience线程池。

3.对于 readTimeoutget请求会重试,postputdelete请求并不会重试。

对于 Get 请求的重试,先开始调用的是会 Timeout 的 192.168.0.142:8001,readtimeout 后重试 192.168.0.142:8002,成功返回

2020-05-27 09:47:27.975  INFO
            [service-provider,5de10ccae7fe4636,cca178414a880ec1] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:28.992  INFO
            [service-provider,5de10ccae7fe4636,947b76400677ab80] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-read-time-out
2020-05-27 09:47:29.002  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:56]:testTimeoutGet zone1

POST,PUT,DELETE 请求 readTimeout 之后,都不会重试:

2020-05-27 09:47:33.059  INFO
            [service-provider,5de10ccae7fe4636,a065f86f497efeff] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-8][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: PUT -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 09:47:34.062 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:74]:testTimeoutPut error: Read timed out

4.对于接口异常 500,get请求会重试,postputdelete请求并不会重试。

对于 Get 请求的重试:

2020-05-27 09:47:35.098  INFO
            [service-provider,5de10ccae7fe4636,cca178414a880ec1] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:35.099  INFO
            [service-provider,5de10ccae7fe4636,18c0b280dbb66634] [6416]
            [bulkhead-service-provider:192.168.0.142:8002-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 09:47:35.104  INFO
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:85]:testExceptionThrownGet zone1

POST,PUT,DELETE 请求 readTimeout 之后,都不会重试:

2020-05-27 09:47:37.119  INFO
            [service-provider,5de10ccae7fe4636,14213e88b6256cc4] [6416]
            [bulkhead-service-provider:192.168.0.142:8001-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 09:47:37.130 ERROR
            [service-provider,5de10ccae7fe4636,5de10ccae7fe4636] [6416]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:95]:testExceptionThrownPost error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 09:47:37 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@282032be

2. 测试 connectTimeout 与断路器打开是否会重试

去掉所有的sleep代码:TimeUnit.SECONDS.sleep(2)

重新调用,这样会触发192.168.0.142:8001这个实例的断路器打开,会看到类似于下面的日志。

GET请求会直接走健康的实例:

2020-05-27 10:21:22.344  INFO
            [service-provider,646176448e323aae,9ad3431d2f902590] [18552]
            [bulkhead-service-provider:192.168.0.142:8002-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 10:21:22.355  INFO
            [service-provider,646176448e323aae,646176448e323aae] [18552]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:84]:testExceptionThrownGet zone1

POST,PUT,DELETE 请求也会重试(因为断路器打开请求并没有发,可以重试其他健康的实例),并有日志提示:

2020-05-27 10:21:22.368  INFO
            [service-provider,646176448e323aae,646176448e323aae] [18552]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.config.CustomizedCircuitBreakerAspect:66]:retry on circuit breaker is on: CircuitBreaker 'service-provider:192.168.0.142:8001' is OPEN and does not permit further calls
2020-05-27 10:21:22.371  INFO
            [service-provider,646176448e323aae,72a9649927744693] [18552]
            [bulkhead-service-provider:192.168.0.142:8002-4][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8002/test-exception-thrown
2020-05-27 10:21:22.375  INFO
            [service-provider,646176448e323aae,646176448e323aae] [18552]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:91]:testExceptionThrownPost zone1

关闭zone1-service-provider-instance1这个实例,然后立刻测试,由于实例更新延迟,当前还会尝试请求zone1-service-provider-instance1,这样就会触发 connectTimeout

对于 GET 请求,会重试:

2020-05-27 11:01:19.994  INFO
            [service-provider,1b89146721dbc129,734840868a313100] [18552]
            [bulkhead-service-provider:192.168.0.142:8001-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-simple
2020-05-27 11:01:21.000  INFO
            [service-provider,1b89146721dbc129,4d69c74c46e4ad18] [18552]
            [bulkhead-service-provider:192.168.0.142:8002-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8002/test-simple
2020-05-27 11:01:21.005  INFO
            [service-provider,1b89146721dbc129,1b89146721dbc129] [18552]
            [XNIO-2 task-3][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:28]:testGet zone1

对于 POST,PUT,DELETE 请求,不会重试:

2020-05-27 11:01:22.021  INFO
            [service-provider,1b89146721dbc129,d944884521bb654b] [18552]
            [bulkhead-service-provider:192.168.0.142:8001-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: POST -> http://192.168.0.142:8001/test-simple
2020-05-27 11:01:23.021 ERROR
            [service-provider,1b89146721dbc129,1b89146721dbc129] [18552]
            [XNIO-2 task-3][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:39]:testPost error: Connect to 192.168.0.142:8001 [/192.168.0.142] failed: connect timed out

3. 测试同 zone 内没有实例的现象

将 zone1 内的所有 service-provider 实例关闭,等待10秒左右(等待实例缓存更新),测试。
可以看到并没有返回其他 zone 的 service-provider:

2020-05-27 11:07:28.653  WARN
            [service-provider,d8ad2db60925852f,d8ad2db60925852f] [18552]
            [boundedElastic-3][com.github.hashjang.hoxton.service.consumer.config.RoundRobinBaseOnTraceIdLoadBalancer:52]:No servers available for service: service-provider
2020-05-27 11:07:28.655  WARN
            [service-provider,d8ad2db60925852f,d8ad2db60925852f] [18552]
            [XNIO-2 task-4][org.springframework.cloud.openfeign.loadbalancer.FeignBlockingLoadBalancerClient:67]:Load balancer does not contain an instance for the service service-provider
2020-05-27 11:07:28.664  WARN
            [service-provider,d8ad2db60925852f,d8ad2db60925852f] [18552]
            [boundedElastic-3][com.github.hashjang.hoxton.service.consumer.config.RoundRobinBaseOnTraceIdLoadBalancer:52]:No servers available for service: service-provider
2020-05-27 11:07:28.665  WARN
            [service-provider,d8ad2db60925852f,d8ad2db60925852f] [18552]
            [XNIO-2 task-4][org.springframework.cloud.openfeign.loadbalancer.FeignBlockingLoadBalancerClient:67]:Load balancer does not contain an instance for the service service-provider
2020-05-27 11:07:28.666 ERROR
            [service-provider,d8ad2db60925852f,d8ad2db60925852f] [18552]
            [XNIO-2 task-4][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:32]:testGet error: [503] during [GET] to [http://service-provider/test-simple] [ServiceProviderTestFeignCleint#testGet(Map)]: [Load balancer does not contain an instance for the service service-provider]

4. 测试不同微服务配置是否隔离

再启动 zone1 的所有 service-provider 实例。测试 service-consumer 的如下代码:

@RequestMapping("/testVariousServiceFeign")
public void testVariousServiceFeign() {
    try {
        log.info("service-provider testTimeoutGet {}", serviceProviderTestReadTimeoutFeignCleint.testTimeoutGet());
    } catch (Exception e) {
        log.error("service-provider testTimeoutGet error: {}", e.getMessage());
    }
    try {
        log.info("service-provider2 testTimeoutGet {}", serviceProvider2TestReadTimeoutFeignCleint.testTimeoutGet());
    } catch (Exception e) {
        log.error("service-provider2 testTimeoutGet error: {}", e.getMessage());
    }
    try {
        log.info("service-provider testExceptionThrownDelete {}", serviceProviderTestExceptionThrownFeignCleint.testExceptionThrownGet());
    } catch (Exception e) {
        log.error("service-provider testExceptionThrownDelete error: {}", e.getMessage());
    }
    try {
        log.info("service-provider2 testExceptionThrownDelete {}", serviceProvider2TestExceptionThrownFeignCleint.testExceptionThrownGet());
    } catch (Exception e) {
        log.error("service-provider2 testExceptionThrownDelete error: {}", e.getMessage());
    }
}

配置是:

feign:
  hystrix:
    enabled: false
  client:
    config:
      default:
        connectTimeout: 1000
        readTimeout: 1000
      service-provider2:
        connectTimeout: 1000
        readTimeout: 8000
        
resilience4j.retry:
  configs:
    default:
      maxRetryAttempts: 1
      waitDuration: 1
      retryExceptions:
        - java.lang.Exception
    service-provider2:
      maxRetryAttempts: 4

这样,微服务 service-provider 的 readTimeout 是 1 秒,service-provider2 的 readTimeout 是 8 秒,所以调用 service-provider 会 readTimeout,但是调用 service-provider2 不会 readTimeout。重试方面, service-provider 会重试 1 次,service-provider2则会重试 4 次。

从日志上看出,的确是这样:

2020-05-27 11:35:11.461  INFO
            [service-provider,22ae9c0806b2a1a1,9b407dbd29038074] [11272]
            [bulkhead-service-provider:192.168.0.142:8001-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-read-time-out
2020-05-27 11:35:12.489 ERROR
            [service-provider,22ae9c0806b2a1a1,22ae9c0806b2a1a1] [11272]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:126]:service-provider testTimeoutGet error: Read timed out
2020-05-27 11:35:12.511  INFO
            [service-provider,22ae9c0806b2a1a1,e4811a2a098219bf] [11272]
            [bulkhead-service-provider2:192.168.0.142:8004-1][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8004/test-read-time-out
2020-05-27 11:35:17.531  INFO
            [service-provider,22ae9c0806b2a1a1,22ae9c0806b2a1a1] [11272]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:129]:service-provider2 testTimeoutGet zone1
2020-05-27 11:35:17.538  INFO
            [service-provider,22ae9c0806b2a1a1,d46022986064751e] [11272]
            [bulkhead-service-provider:192.168.0.142:8001-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8001/test-exception-thrown
2020-05-27 11:35:17.560 ERROR
            [service-provider,22ae9c0806b2a1a1,22ae9c0806b2a1a1] [11272]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:136]:service-provider testExceptionThrownDelete error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 11:35:17 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@d77e01d
2020-05-27 11:35:17.564  INFO
            [service-provider,22ae9c0806b2a1a1,27b1c085d8d575e8] [11272]
            [bulkhead-service-provider2:192.168.0.142:8004-2][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8004/test-exception-thrown
2020-05-27 11:35:18.078  INFO
            [service-provider,22ae9c0806b2a1a1,9b58bfb4335cf943] [11272]
            [bulkhead-service-provider2:192.168.0.142:8004-3][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8004/test-exception-thrown
2020-05-27 11:35:18.588  INFO
            [service-provider,22ae9c0806b2a1a1,3352ea0e472e64de] [11272]
            [bulkhead-service-provider2:192.168.0.142:8004-4][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8004/test-exception-thrown
2020-05-27 11:35:19.100  INFO
            [service-provider,22ae9c0806b2a1a1,a40281d44d528908] [11272]
            [bulkhead-service-provider2:192.168.0.142:8004-5][com.github.hashjang.hoxton.service.consumer.config.LoadBalancerConfig$CircuitBreakableClient:113]:call url: GET -> http://192.168.0.142:8004/test-exception-thrown
2020-05-27 11:35:19.115 ERROR
            [service-provider,22ae9c0806b2a1a1,22ae9c0806b2a1a1] [11272]
            [XNIO-2 task-1][com.github.hashjang.hoxton.service.consumer.controller.TestFeignController:141]:service-provider2 testExceptionThrownDelete error: HTTP/1.1 500 Internal Server Error
connection: keep-alive
content-type: application/json
date: Wed, 27 May 2020 11:35:19 GMT
transfer-encoding: chunked

feign.httpclient.ApacheHttpClient$1@107e2ead
2020-05-27 11:40:05.435  INFO
            [service-provider,,] [11272]
            [AsyncResolver-bootstrap-executor-0][com.netflix.discovery.shared.resolver.aws.ConfigClusterResolver:43]:Resolving eureka endpoints via configuration

5. 测试 api-gateway 的加解密

启动 api-gateway,发送请求:

curl --location --request POST 'http://127.0.0.1:8201/service-provider/test-simple' \
--header 'Content-Type: application/json' \
--data-raw '{
	"test":"test1234",
	"key":"key1234"
}'

service-provider 的实例上可以看到:

2020-05-28 07:20:40.198  INFO
            [service-provider,1abdf34e5bd1e6bc,7e472f324fa44d94] [16604]
            [XNIO-2 task-458][com.github.hashjang.hoxton.service.provider.controller.TestServiceController:26]:test called POST, body {decrypted=test1234}

api-gateway 上面的日志:

2020-05-28 07:20:40.176  INFO [service-api-gateway,1abdf34e5bd1e6bc,1abdf34e5bd1e6bc]
            [1056] [reactor-http-nio-3][com.github.hashjang.hoxton.api.gateway.filter.EncryptFilter:50]: decrypt data: EncryptFilter.DecryptResult(successful=true, result={"decrypted":"test1234"}, key=key1234)
2020-05-28 07:20:40.185  INFO [service-api-gateway,1abdf34e5bd1e6bc,1abdf34e5bd1e6bc]
            [1056] [boundedElastic-56][com.github.hashjang.hoxton.api.gateway.filter.InstanceCircuitBreakerFilter:53]: try to send request to: http://192.168.0.142:8002/test-simple: stats: {"numberOfNotPermittedCalls":0,"numberOfSlowCalls":0,"numberOfBufferedCalls":0,"numberOfSlowSuccessfulCalls":0,"numberOfSuccessfulCalls":0,"numberOfSlowFailedCalls":0,"numberOfFailedCalls":0,"slowCallRate":-1.0,"failureRate":-1.0}
2020-05-28 07:20:40.203  INFO [service-api-gateway,1abdf34e5bd1e6bc,1abdf34e5bd1e6bc]
            [1056] [reactor-http-nio-4][com.github.hashjang.hoxton.api.gateway.filter.EncryptFilter$1:106]: encrypt response: zone1

请求响应是:

zone1 - key1234

可以看出,request body 还有 response body 都成功被修改。之后压测下这个接口。

6. api-gateway 重试

请求会触发 instance1 readTimeout 接口。

curl --location --request GET 'http://127.0.0.1:8201/service-provider/test-read-time-out' 

发现有重试:

2020-05-28 07:23:55.746  INFO [service-api-gateway,96379b064aa79589,96379b064aa79589]
            [1056] [boundedElastic-57][com.github.hashjang.hoxton.api.gateway.filter.InstanceCircuitBreakerFilter:53]: try to send request to: http://192.168.0.142:8001/test-read-time-out: stats: {"numberOfNotPermittedCalls":0,"numberOfSlowCalls":0,"numberOfBufferedCalls":0,"numberOfSlowSuccessfulCalls":0,"numberOfSuccessfulCalls":0,"numberOfSlowFailedCalls":0,"numberOfFailedCalls":0,"slowCallRate":-1.0,"failureRate":-1.0}
2020-05-28 07:23:56.851  INFO [service-api-gateway,96379b064aa79589,96379b064aa79589]
            [1056] [boundedElastic-57][com.github.hashjang.hoxton.api.gateway.filter.InstanceCircuitBreakerFilter:53]: try to send request to: http://192.168.0.142:8002/test-read-time-out: stats: {"numberOfNotPermittedCalls":0,"numberOfSlowCalls":0,"numberOfBufferedCalls":0,"numberOfSlowSuccessfulCalls":0,"numberOfSuccessfulCalls":0,"numberOfSlowFailedCalls":0,"numberOfFailedCalls":0,"slowCallRate":-1.0,"failureRate":-1.0}

多线程并发请求,发现 instance1 的断路器打开,有一段时间仅把请求发送到 instance2

对于接口异常同理也会重试,尝试请求 instance1 有异常的接口:

curl --location --request GET 'http://127.0.0.1:8201/service-provider/test-exception-thrown' 

发现也会重试:

2020-05-28 07:27:01.155  INFO [service-api-gateway,a9859e558a3f985e,a9859e558a3f985e]
            [1056] [boundedElastic-58][com.github.hashjang.hoxton.api.gateway.filter.InstanceCircuitBreakerFilter:53]: try to send request to: http://192.168.0.142:8001/test-exception-thrown: stats: {"numberOfNotPermittedCalls":0,"numberOfSlowCalls":0,"numberOfBufferedCalls":1,"numberOfSlowSuccessfulCalls":0,"numberOfSuccessfulCalls":0,"numberOfSlowFailedCalls":0,"numberOfFailedCalls":1,"slowCallRate":-1.0,"failureRate":-1.0}
2020-05-28 07:27:01.314  INFO [service-api-gateway,a9859e558a3f985e,a9859e558a3f985e]
            [1056] [boundedElastic-58][com.github.hashjang.hoxton.api.gateway.filter.InstanceCircuitBreakerFilter:53]: try to send request to: http://192.168.0.142:8002/test-exception-thrown: stats: {"numberOfNotPermittedCalls":0,"numberOfSlowCalls":0,"numberOfBufferedCalls":0,"numberOfSlowSuccessfulCalls":0,"numberOfSuccessfulCalls":0,"numberOfSlowFailedCalls":0,"numberOfFailedCalls":0,"slowCallRate":-1.0,"failureRate":-1.0}

多线程并发请求,发现 instance1 的断路器打开,有一段时间仅把请求发送到 instance2

Logo

权威|前沿|技术|干货|国内首个API全生命周期开发者社区

更多推荐