深海游弋的鱼 – 默默的点滴

macOS Big Sur(11.6.7/Intel CPU)编译Android/iOS/macOS版本的RocksDB 6.29.5

从 RocksDB 7.0 开始，RocksDB 要求编译的 C++ 必须支持 C++ 17 ，（ Dropping some compiler support in 7.0#9388）但是目前的Android/iOS版本显然暂时还不能大范围的适配 C++ 17，因此我们目前只能使用 6.x 版本。

Android:

# Android NDK 22.1.7171670

$ brew install git

$ brew install cmake

$ brew install sed

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

# 修改代码，消除警告视为错误，否则会编译不通过
$ gsed -i "s/-Werror//g" CMakeLists.txt

# Android最低支持的版本是 Android 23 低于这个版本会出现API缺失导致编译失败

$ cmake . -DCMAKE_ANDROID_NDK=/Users/xxxx/Library/Android/sdk/ndk-bundle \
-DCMAKE_SYSTEM_NAME=Android \
-DCMAKE_SYSTEM_VERSION=23 \
-DCMAKE_ANDROID_STL_TYPE=c++_shared \
-DROCKSDB_LITE=ON \
-DPORTABLE=ON \
-DCMAKE_POSITION_INDEPENDENT_CODE=ON \
-DWITH_TESTS=OFF \
-DWITH_TOOLS=OFF \
-DWITH_GFLAGS=OFF \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_ANDROID_ARCH_ABI=arm64-v8a 

// -DCMAKE_ANDROID_ARCH_ABI=arm64-v8a 
// -DCMAKE_ANDROID_ARCH_ABI=armeabi-v7a 
// -DCMAKE_ANDROID_ARCH_ABI=armeabi 
// -DCMAKE_ANDROID_ARCH_ABI=x86 
// -DCMAKE_ANDROID_ARCH_ABI=x86_64

$ make

# 在当前目录下生成
# librocksdb.so

# Android NDK 22.1.7171670

$ brew install git

$ brew install cmake

$ brew install sed

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

# 修改代码，消除警告视为错误，否则会编译不通过

$ gsed -i "s/-Werror//g" CMakeLists.txt

# Android最低支持的版本是 Android 23 低于这个版本会出现API缺失导致编译失败

$ cmake . -DCMAKE_ANDROID_NDK=/Users/xxxx/Library/Android/sdk/ndk-bundle \

-DCMAKE_SYSTEM_NAME=Android \

-DCMAKE_SYSTEM_VERSION=23 \

-DCMAKE_ANDROID_STL_TYPE=c++_shared \

-DROCKSDB_LITE=ON \

-DPORTABLE=ON \

-DCMAKE_POSITION_INDEPENDENT_CODE=ON \

-DWITH_TESTS=OFF \

-DWITH_TOOLS=OFF \

-DWITH_GFLAGS=OFF \

-DCMAKE_BUILD_TYPE=Release \

-DCMAKE_ANDROID_ARCH_ABI=arm64-v8a

// -DCMAKE_ANDROID_ARCH_ABI=arm64-v8a

// -DCMAKE_ANDROID_ARCH_ABI=armeabi-v7a

// -DCMAKE_ANDROID_ARCH_ABI=armeabi

// -DCMAKE_ANDROID_ARCH_ABI=x86

// -DCMAKE_ANDROID_ARCH_ABI=x86_64

$ make

# 在当前目录下生成

# librocksdb.so

iOS/macOS ARM:

#Xcode Version 13.2.1 (13C100)

$ brew install git

$ brew install cmake

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

$ export PORTABLE=1

$ export TARGET_OS=IOS

$ export ROCKSDB_LITE=1

$ export IOS_CROSS_COMPILE=1

# int128兼容支持，默认支持，但是在iOS设备上是不支持的
$ export TEST_UINT128_COMPAT=1

$ export DISABLE_WARNING_AS_ERROR=1

$ export DEBUG_LEVEL=0 

$ export EXTRA_CXXFLAGS="-DNPERF_CONTEXT -DNIOSTATS_CONTEXT"

# iOS目前只能构建静态库，不能构建动态库
$ make V=1 VERBOSE=1 -j16 static_lib

#Xcode Version 13.2.1 (13C100)

$ brew install git

$ brew install cmake

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

$ export PORTABLE=1

$ export TARGET_OS=IOS

$ export ROCKSDB_LITE=1

$ export IOS_CROSS_COMPILE=1

# int128兼容支持，默认支持，但是在iOS设备上是不支持的

$ export TEST_UINT128_COMPAT=1

$ export DISABLE_WARNING_AS_ERROR=1

$ export DEBUG_LEVEL=0

$ export EXTRA_CXXFLAGS="-DNPERF_CONTEXT -DNIOSTATS_CONTEXT"

# iOS目前只能构建静态库，不能构建动态库

$ make V=1 VERBOSE=1 -j16 static_lib

macOS x86:

#Xcode Version 13.2.1 (13C100)

$ brew install git

$ brew install cmake

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

$ export PORTABLE=1

$ export ROCKSDB_LITE=1

# int128兼容支持，默认支持，但是在iOS设备上是不支持的
$ export TEST_UINT128_COMPAT=1

$ export DISABLE_WARNING_AS_ERROR=1

$ export DEBUG_LEVEL=0 

$ export EXTRA_CXXFLAGS="-DNPERF_CONTEXT -DNIOSTATS_CONTEXT"

$ make V=1 VERBOSE=1 -j16 static_lib

# make V=1 VERBOSE=1 -j16 shared_lib 动态库

#Xcode Version 13.2.1 (13C100)

$ brew install git

$ brew install cmake

$ git clone https://github.com/facebook/rocksdb.git

$ git checkout v6.29.5

$ export PORTABLE=1

$ export ROCKSDB_LITE=1

# int128兼容支持，默认支持，但是在iOS设备上是不支持的

$ export TEST_UINT128_COMPAT=1

$ export DISABLE_WARNING_AS_ERROR=1

$ export DEBUG_LEVEL=0

$ export EXTRA_CXXFLAGS="-DNPERF_CONTEXT -DNIOSTATS_CONTEXT"

$ make V=1 VERBOSE=1 -j16 static_lib

# make V=1 VERBOSE=1 -j16 shared_lib 动态库

参考链接

RocksDB使用入门macOS Big Sur (11.6.6)

这篇文章就简单介绍怎么在macOS下使用RocksDB。

1. RocksDB简要介绍

RocksDB是一个可嵌入的、持久型的Key-Value存储。

不像MySQL，PostgreSQL这样数据库分客户端与服务器端。实际上，可以把它当作一个第三方库，在自己的代码中进行引用，调用相应的接口就可以使用，比如使用C/C++语言，直接在源代码中include相应的头文件就可以。

与嵌入式数据库SQLite的使用比较类似。

目前: RocksDB使用LSM存储引擎，纯C++编写。Java版本RocksJava也已经完美支持。

更多有关RocksDB的介绍参考:

英文官网: https://rocksdb.org/

关于RocksDB的详细使用介绍:

Github Wiki: https://github.com/facebook/rocksdb/wiki

2. RocksDB 安装

macOS上安装RocksDB非常简单，不用单独安装其他任何依赖。直接使用brew工具安装即可。

$ brew install rocksdb

1	$ brew install rocksdb

可以运行一下命令来查看安装信息。

$ brew info rocksdb

1	$ brew info rocksdb

安装结果如下。

$ brew info rocksdb
rocksdb: stable 7.0.3 (bottled), HEAD
Embeddable, persistent key-value store for fast storage
https://rocksdb.org/
/usr/local/Cellar/rocksdb/7.0.3 (138 files, 40.4MB) *
  Poured from bottle on 2022-06-20 at 14:18:52
From: https://mirrors.ustc.edu.cn/homebrew-core.git/Formula/rocksdb.rb
License: GPL-2.0-only or Apache-2.0
==> Dependencies
Build: cmake ✔
Required: gflags ✔, lz4 ✔, snappy ✔, zstd ✔
==> Options
--HEAD
	Install HEAD version
==> Analytics
install: 605 (30 days), 2,584 (90 days), 12,941 (365 days)
install-on-request: 561 (30 days), 2,247 (90 days), 10,385 (365 days)
build-error: 1 (30 days)

$ brew info rocksdb

rocksdb: stable 7.0.3 (bottled), HEAD

Embeddable, persistent key-value store for fast storage

https://rocksdb.org/

/usr/local/Cellar/rocksdb/7.0.3 (138 files, 40.4MB) *

Poured from bottle on 2022-06-20 at 14:18:52

From: https://mirrors.ustc.edu.cn/homebrew-core.git/Formula/rocksdb.rb

License: GPL-2.0-only or Apache-2.0

==> Dependencies

Build: cmake ✔

Required: gflags ✔, lz4 ✔, snappy ✔, zstd ✔

==> Options

--HEAD

Install HEAD version

==> Analytics

install: 605 (30 days), 2,584 (90 days), 12,941 (365 days)

install-on-request: 561 (30 days), 2,247 (90 days), 10,385 (365 days)

build-error: 1 (30 days)

其他操作系统上的安装可以参考：

官方安装教程：https://github.com/facebook/rocksdb/blob/master/INSTALL.md
CentOS 7上安装：https://www.jianshu.com/p/f233528c8303

3. 使用示例

代码目录：

main.cpp
Makefile

main.cpp文件内容：

#include <iostream>
#include <cassert>
#include "rocksdb/db.h"

using namespace std;

int main() {
    rocksdb::DB* db;
    rocksdb::Options options;
    options.create_if_missing = true;
    rocksdb::Status status = rocksdb::DB::Open(options, "/tmp/testdb", &db);
    assert(status.ok());
    cout << "Open rocksdb success." << endl;

    string key1 = "1";
    string value1 = "aaaaa";
    status = db->Put(rocksdb::WriteOptions(), key1, value1);
    assert(status.ok());
    printf("Put[%s,%s] success.\n", key1.c_str(), value1.c_str());
    
    string value;
    status = db->Get(rocksdb::ReadOptions(), key1, &value);
    assert(status.ok());
    printf("Put key[%s] = %s\n", key1.c_str(), value.c_str());

    status = db->Delete(rocksdb::WriteOptions(), key1);
    assert(status.ok());
    printf("Delete key[%s] success.\n", key1.c_str());

    delete db;

    return 0;
}

#include <iostream>

#include <cassert>

#include "rocksdb/db.h"

using namespace std;

int main() {

rocksdb::DB* db;

rocksdb::Options options;

options.create_if_missing = true;

rocksdb::Status status = rocksdb::DB::Open(options, "/tmp/testdb", &db);

assert(status.ok());

cout << "Open rocksdb success." << endl;

string key1 = "1";

string value1 = "aaaaa";

status = db->Put(rocksdb::WriteOptions(), key1, value1);

assert(status.ok());

printf("Put[%s,%s] success.\n", key1.c_str(), value1.c_str());

string value;

status = db->Get(rocksdb::ReadOptions(), key1, &value);

assert(status.ok());

printf("Put key[%s] = %s\n", key1.c_str(), value.c_str());

status = db->Delete(rocksdb::WriteOptions(), key1);

assert(status.ok());

printf("Delete key[%s] success.\n", key1.c_str());

delete db;

return 0;

}

Makefile文件内容：

CXX=g++ -std=c++11
CXXFLAGS=-lrocksdb  # 注意添加链接库

all: main

main: main.cpp
	$(CXX) $(CXXFLAGS) -o $@ $< 

run: main
	./main

clean:
	rm -f main *.o

CXX=g++ -std=c++11

CXXFLAGS=-lrocksdb # 注意添加链接库

all: main

main: main.cpp

$(CXX) $(CXXFLAGS) -o $@ $<

run: main

./main

clean:

rm -f main *.o

运行结果：

make run
g++ -std=c++11 -lrocksdb   -o main main.cpp 
./main
Open rocksdb success.
Put[1,aaaaa] success.
Put key[1] = aaaaa
Delete key[1] success.

make run

g++ -std=c++11 -lrocksdb -o main main.cpp

./main

Open rocksdb success.

Put[1,aaaaa] success.

Put key[1] = aaaaa

Delete key[1] success.

编译时需要注意两点:

支持C11, 添加选项-std=c++11
添加链接库: -lrocksdb

参考链接

RocksDB使用入门 Mac

Flutter 2.10.1/Xcode 13.2.1/macOS Big Sur 11.6.4在iPad Pro iOS 15.3.1真机免费调试

系统与开发环境 Flutter 2.10.1/Xcode 13.2.1(13C100)/macOS Big Sur 11.6.4/iPad Pro(Model A1673) iOS 15.3.1

操作步骤

1. 苹果开发网站注册或关联开发者账号，如果暂时不需要发布应用到 Mac App Store，只是在设备上调试应用，则不需要注册收费用户，只需要注册或者关联账号即可。具体可以查看官方介绍选择会员资格。

2. 在 iPad Pro 和 macbook Pro 登陆同一个注册的开发者的账号。

3. 通过 USB 数据线把 iPad Pro 与 macbook Pro 设备连接起来，如下图：

继续阅读Flutter 2.10.1/Xcode 13.2.1/macOS Big Sur 11.6.4在iPad Pro iOS 15.3.1真机免费调试

macOS Big Sur(11.6.2) Android Studio (version 2020.3) 执行 flutter doctor 报错

$ flutter doctor

Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 1.22.5, on macOS 11.6.2 20G314 darwin-x64, locale zh-Hans-CN)
[!] Android toolchain - develop for Android devices (Android SDK version 30.0.2)
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/macos#android-setup for more details.
 
[✓] Xcode - develop for iOS and macOS (Xcode 13.2.1)
[!] Android Studio (version 2020.3)
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    ✗ Unable to find bundled Java version.
[!] IntelliJ IDEA Ultimate Edition (version 2018.3.6)
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
[✓] VS Code (version 1.63.2)
[✓] Connected device (1 available)

! Doctor found issues in 3 categories.

$ flutter doctor

Doctor summary (to see all details, run flutter doctor -v):

[✓] Flutter (Channel stable, 1.22.5, on macOS 11.6.2 20G314 darwin-x64, locale zh-Hans-CN)

[!] Android toolchain - develop for Android devices (Android SDK version 30.0.2)

✗ Android license status unknown.

Run `flutter doctor --android-licenses` to accept the SDK licenses.

See https://flutter.dev/docs/get-started/install/macos#android-setup for more details.

[✓] Xcode - develop for iOS and macOS (Xcode 13.2.1)

[!] Android Studio (version 2020.3)

✗ Flutter plugin not installed; this adds Flutter specific functionality.

✗ Dart plugin not installed; this adds Dart specific functionality.

✗ Unable to find bundled Java version.

[!] IntelliJ IDEA Ultimate Edition (version 2018.3.6)

✗ Flutter plugin not installed; this adds Flutter specific functionality.

✗ Dart plugin not installed; this adds Dart specific functionality.

[✓] VS Code (version 1.63.2)

[✓] Connected device (1 available)

! Doctor found issues in 3 categories.

在执行 flutter doctor --android-licenses 的时候报错：

$ flutter doctor --android-licenses

Exception in thread "main" java.lang.NoClassDefFoundError: javax/xml/bind/annotation/XmlSchema
        at com.android.repository.api.SchemaModule$SchemaModuleVersion.<init>(SchemaModule.java:156)
        at com.android.repository.api.SchemaModule.<init>(SchemaModule.java:75)
        at com.android.sdklib.repository.AndroidSdkHandler.<clinit>(AndroidSdkHandler.java:81)
        at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:73)
        at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:48)
Caused by: java.lang.ClassNotFoundException: javax.xml.bind.annotation.XmlSchema
        at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
        at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        ... 5 more

$ flutter doctor --android-licenses

Exception in thread "main" java.lang.NoClassDefFoundError: javax/xml/bind/annotation/XmlSchema

at com.android.repository.api.SchemaModule$SchemaModuleVersion.<init>(SchemaModule.java:156)

at com.android.repository.api.SchemaModule.<init>(SchemaModule.java:75)

at com.android.sdklib.repository.AndroidSdkHandler.<clinit>(AndroidSdkHandler.java:81)

at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:73)

at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:48)

Caused by: java.lang.ClassNotFoundException: javax.xml.bind.annotation.XmlSchema

at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)

at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)

at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)

... 5 more

原因为 Java 版本太高，Flutter 1.22.5 只能使用 Java 1.8版本：

$ export JAVA_HOME=/Users/xxxx/Library/Java/JavaVirtualMachines/corretto-1.8.0_312/Contents/Home

$ flutter doctor --android-licenses

$ export JAVA_HOME=/Users/xxxx/Library/Java/JavaVirtualMachines/corretto-1.8.0_312/Contents/Home

$ flutter doctor --android-licenses

对于错误

[!] Android Studio (version 2020.3)
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    ✗ Unable to find bundled Java version.

[!] Android Studio (version 2020.3)

✗ Flutter plugin not installed; this adds Flutter specific functionality.

✗ Dart plugin not installed; this adds Dart specific functionality.

✗ Unable to find bundled Java version.

原因:

Plugin folder has changed in 4.1 version;
From : ~/Library/Application\ Support/AndroidStudio4.1
To: ~/Library/Application\ Support/Google/AndroidStudio4.1/plugins

Plugin folder has changed in 4.1 version;

From : ~/Library/Application\ Support/AndroidStudio4.1

To: ~/Library/Application\ Support/Google/AndroidStudio4.1/plugins

Android Studio(4.1)后，安装插件的位置发生了变化，但是flutter doctor还是去原先的位置找，导致的安装过插件还报错。

解决方法：

$ ln -s ~/Library/Application\ Support/Google/AndroidStudio2020.3/plugins ~/Library/Application\ Support/AndroidStudio2020.3

1	$ ln -s ~/Library/Application\ Support/Google/AndroidStudio2020.3/plugins ~/Library/Application\ Support/AndroidStudio2020.3

更简单的方式是执行

$ flutter upgrade

1	$ flutter upgrade

升级到 flutter 2.8.1 以及之后的版本即可。

参考链接

macOS Monterey (12.0.1)解决App Store无法下载APP的问题

最近，公司的一台电脑升级到 macOS Monterey (12.0.1)，之后从进行软件更新，以及 XCode 的下载安装。由于网速的限制，临时把 XCode 的下载进行了暂停操作，之后忘记恢复就进行了重启。

结果第二天在App的安装界面上就看不到被暂停的任务了。然后在 App Store 中尝试继续进行下载，发现无法进行下载任务，下载按钮点击之后，状态一闪而过，又回到待下载状态。

更换账号/重启应用/重启系统之后，无法解决问题。

应该是 App Store 内部状态混乱了，导致无法进行下载任务，需要对 App Store 进行重置操作。

网上搜索很久，才找到解决方案，执行如下命令：

$ sudo find /private/var/folders/ -iname 'com.apple.appstore' 2>/dev/null | while IFS='' read -r line; do rm -fr "$line"; done; rm -fr ~/Library/Caches/*store*; ps aux | egrep -i 'app.?store' | awk '{ print $2 }' | while IFS='' read -r line; do kill -9 "$line"; done

1	$ sudo find /private/var/folders/ -iname 'com.apple.appstore' 2>/dev/null \| while IFS='' read -r line; do rm -fr "$line"; done; rm -fr ~/Library/Caches/store; ps aux \| egrep -i 'app.?store' \| awk '{ print $2 }' \| while IFS='' read -r line; do kill -9 "$line"; done

之后重启系统，重新点击下载应用，即可解决问题。

参考链接

OS X EI Capitan(10.11.6)报错'os/availability.h' file not found

==> Installing gradle dependency: openjdk
==> ./configure --disable-warnings-as-errors --with-boot-jdk-jvmargs=-Duser.home
==> make images
Last 15 lines from /Users/xxx/Library/Logs/Homebrew/openjdk/02.make:
In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.12.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CFBase.h:18:
/Library/Developer/CommandLineTools/SDKs/MacOSX10.12.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CFAvailability.h:21:10: fatal error: 'os/availability.h' file not found
#include <os/availability.h>
         ^
1 error generated.

* All command lines available in /private/tmp/openjdk-20210919-6132-1pm1i4r/jdk16u-jdk-16.0.1-ga/build/macosx-x86_64-server-release/make-support/failure-logs.
=== End of repeated output ===

No indication of failed target found.
Hint: Try searching the build log for '] Error'.
Hint: See doc/building.html#troubleshooting for assistance.

==> Installing gradle dependency: openjdk

==> ./configure --disable-warnings-as-errors --with-boot-jdk-jvmargs=-Duser.home

==> make images

Last 15 lines from /Users/xxx/Library/Logs/Homebrew/openjdk/02.make:

In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.12.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CFBase.h:18:

/Library/Developer/CommandLineTools/SDKs/MacOSX10.12.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers/CFAvailability.h:21:10: fatal error: 'os/availability.h' file not found

#include <os/availability.h>

1 error generated.

* All command lines available in /private/tmp/openjdk-20210919-6132-1pm1i4r/jdk16u-jdk-16.0.1-ga/build/macosx-x86_64-server-release/make-support/failure-logs.

=== End of repeated output ===

No indication of failed target found.

Hint: Try searching the build log for '] Error'.

Hint: See doc/building.html#troubleshooting for assistance.

解决方案：

$ export CPATH=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/:$CPATH

$ sudo rm -rf /Library/Developer/CommandLineTools

$ xcode-select --install

$ export CPATH=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/:$CPATH

$ sudo rm -rf /Library/Developer/CommandLineTools

$ xcode-select --install

参考链接

macOS Big Sur(11.4)安装指定版本Node

# 安装配置 Node Version Manager，用来管理安装使用特定版本
$ git clone https://github.com/nvm-sh/nvm.git

$ cd nvm 

$ bash install.sh

# 刷新环境变量，使得设置生效
$ source ~/.bashrc

$ nvm install 12.16.2

$ nvm use 12.16.2

# 安装配置 Node Version Manager，用来管理安装使用特定版本

$ git clone https://github.com/nvm-sh/nvm.git

$ cd nvm

$ bash install.sh

# 刷新环境变量，使得设置生效

$ source ~/.bashrc

$ nvm install 12.16.2

$ nvm use 12.16.2

参考链接

NSURLProtocol -- DNS劫持和Web资源本地化

什么是DNS劫持

DNS劫持就是通过劫持了DNS服务器，通过某些手段取得某域名的解析记录控制权，进而修改此域名的解析结果，导致对该域名的访问由原IP地址转入到修改后的指定IP，其结果就是对特定的网址不能访问或访问的是假网址，从而实现窃取资料或者破坏原有正常服务的目的。
　常见的DNS劫持现象网络运营商向网页中注入了Javascript代码，甚至直接将我们的网页请求转发到他们自己的广告页面或者通过自己的DNS服务器将用户请求的域名指向到非法地址

如何解决DNS被劫持

全站使用HTTPS协议，或者采用HttpDNS，通过HTTP向自建的DNS服务器或者安全的DNS服务器发送域名解析请求，然后根据解析结果设置客户端的Host指向，从而绕过网络运营商的DNS解析服务。

本文的解决方案

客户端对WebView的html请求进行DNS解析。优先使用阿里、腾讯、114等公共安全的DNS服务器解析客户端的所有指定域名的http请求。相对来讲我们自己的服务域名变化较少，对此我们做了一个白名单，把凡是访问包含我们公司域名的请求都必须通过白名单的解析和DNS验证。从而杜绝被劫持的情况出现，这时候NSURLProtocol就派上用场了。

NSURLProtocol

这是一个抽象类，所以在oc中只能通过继承来重写父类的方法。

@interface XRKURLProtocol : NSURLProtocol
@end

1 2	@interface XRKURLProtocol : NSURLProtocol @end

然后在AppDelegate的 application:didFinishLaunchingWithOptions: 方法或者程序首次请求网络数据之前去注册这个NSURLProtocol的子类

- (BOOL)application:(UIApplication *)application didFinishLaunchingWithOptions:(NSDictionary *)launchOptions {
     [NSURLProtocol registerClass:[XRKURLProtocol class]];
}

- (BOOL)application:(UIApplication *)application didFinishLaunchingWithOptions:(NSDictionary *)launchOptions {

[NSURLProtocol registerClass:[XRKURLProtocol class]];

}

注册了自定义的urlProtocol子类后，之后每一个http请求都会先经过该类过滤并且通过+canInitWithRequest:这个方法返回一个布尔值告诉系统该请求是否需要处理，返回Yes才能进行后续处理。

+ (BOOL)canInitWithRequest:(NSURLRequest *)request {
    if ([NSURLProtocol propertyForKey:URLProtocolHandledKey inRequest:request]) {
        return NO;
    }

    //http和https都会出现dns劫持情况，都需要处理
    NSString *scheme = [[request URL] scheme];
    if (([scheme caseInsensitiveCompare:@"http"] == NSOrderedSame)) {
        // 判断请求是否为白名单
        NSArray *whiteLists = [XRKConfigManager sharedManager].whiteList;
        if (whiteLists && [whiteLists isKindOfClass:[NSArray class]]) {
            for (NSString *url in whiteLists) {
                if (request.URL.host && [request.URL.host hasSuffix:url]) {
                    return YES;
                }
            }
        }
    }

    return NO;
}

+ (BOOL)canInitWithRequest:(NSURLRequest *)request {

if ([NSURLProtocol propertyForKey:URLProtocolHandledKey inRequest:request]) {

return NO;

}

//http和https都会出现dns劫持情况，都需要处理

NSString *scheme = [[request URL] scheme];

if (([scheme caseInsensitiveCompare:@"http"] == NSOrderedSame)) {

// 判断请求是否为白名单

NSArray *whiteLists = [XRKConfigManager sharedManager].whiteList;

if (whiteLists && [whiteLists isKindOfClass:[NSArray class]]) {

for (NSString *url in whiteLists) {

if (request.URL.host && [request.URL.host hasSuffix:url]) {

return YES;

}

return NO;

}

+canonicalRequestForRequest:这个父类的抽象方法子类必须实现。

+ (NSURLRequest *)canonicalRequestForRequest:(NSURLRequest *)request {
    return request;
}

+ (NSURLRequest *)canonicalRequestForRequest:(NSURLRequest *)request {

return request;

}

以下是官方对这个方法的解释。当我们想对某个请求添加请求头或者返回新的请求时，可以在这个方法里自定义然后返回，一般情况下直接返回参数里的NSURLRequest实例即可。

It is up to each concrete protocol implementation to define what “canonical” means. A protocol should guarantee that the same input request always yields the same canonical form.

+requestIsCacheEquivalent:toRquest:这个方法能够判断当拦截URL相同时是否使用缓存数据，以下例子是直接返回父类实现。

+ (BOOL)requestIsCacheEquivalent:(NSURLRequest *)a toRequest:(NSURLRequest *)b {
    return [super requestIsCacheEquivalent:a toRequest:b];
}

+ (BOOL)requestIsCacheEquivalent:(NSURLRequest *)a toRequest:(NSURLRequest *)b {

return [super requestIsCacheEquivalent:a toRequest:b];

}

-startLoading和-stopLoading两个方法分别告诉NSURLProtocol实现开始和取消请求的处理。

- (void)startLoading {
    NSMutableURLRequest *mutableReqeust = [[self request] mutableCopy];

    //打标签，防止无限循环
    [NSURLProtocol setProperty:@YES forKey:URLProtocolHandledKey inRequest:mutableReqeust];
    // dns解析
    NSMutableURLRequest *request = [self.class replaceHostInRequset:mutableReqeust];
    self.connection = [NSURLConnection connectionWithRequest:request delegate:self];
}

+ (NSMutableURLRequest *)replaceHostInRequset:(NSMutableURLRequest *)request {
    if ([request.URL host].length == 0) {
        return request;
    }

    NSString *originUrlString = [request.URL absoluteString];
    NSString *originHostString = [request.URL host];
    NSRange hostRange = [originUrlString rangeOfString:originHostString];
    if (hostRange.location == NSNotFound) {
        return request;
    }

    //用HappyDNS 替换host
    NSMutableArray *array = [NSMutableArray array];
    /// 第一dns解析为114，第二解析才是系统dns
    [array addObject:[[QNResolver alloc] initWithAddress:@"114.114.115.115"]];
    [array addObject:[QNResolver systemResolver]];
    QNDnsManager *dnsManager = [[QNDnsManager alloc] init:array networkInfo:[QNNetworkInfo normal]];
    NSArray *queryArray = [dnsManager query:originHostString];
    if (queryArray && queryArray.count > 0) {
        NSString *ip = queryArray[0];
        if (ip && ip.length) {
            // 替换host
            NSString *urlString = [originUrlString stringByReplacingCharactersInRange:hostRange withString:ip];
            NSURL *url = [NSURL URLWithString:urlString];
            request.URL = url;

            [request setValue:originHostString forHTTPHeaderField:@"Host"];
        }
    }

    return request;
}

- (void)startLoading {

NSMutableURLRequest *mutableReqeust = [[self request] mutableCopy];

//打标签，防止无限循环

[NSURLProtocol setProperty:@YES forKey:URLProtocolHandledKey inRequest:mutableReqeust];

// dns解析

NSMutableURLRequest *request = [self.class replaceHostInRequset:mutableReqeust];

self.connection = [NSURLConnection connectionWithRequest:request delegate:self];

}

+ (NSMutableURLRequest *)replaceHostInRequset:(NSMutableURLRequest *)request {

if ([request.URL host].length == 0) {

return request;

}

NSString *originUrlString = [request.URL absoluteString];

NSString *originHostString = [request.URL host];

NSRange hostRange = [originUrlString rangeOfString:originHostString];

if (hostRange.location == NSNotFound) {

return request;

}

//用HappyDNS 替换host

NSMutableArray *array = [NSMutableArray array];

/// 第一dns解析为114，第二解析才是系统dns

[array addObject:[[QNResolver alloc] initWithAddress:@"114.114.115.115"]];

[array addObject:[QNResolver systemResolver]];

QNDnsManager *dnsManager = [[QNDnsManager alloc] init:array networkInfo:[QNNetworkInfo normal]];

NSArray *queryArray = [dnsManager query:originHostString];

if (queryArray && queryArray.count > 0) {

NSString *ip = queryArray[0];

if (ip && ip.length) {

// 替换host

NSString *urlString = [originUrlString stringByReplacingCharactersInRange:hostRange withString:ip];

NSURL *url = [NSURL URLWithString:urlString];

request.URL = url;

[request setValue:originHostString forHTTPHeaderField:@"Host"];

}

return request;

}

- (void)stopLoading {
    [self.connection cancel];
}

- (void)stopLoading {

[self.connection cancel];

}

由于我们在-startLoading中新建了一个NSURLConnection实例，因此要实现NSURLConnectionDelegate的委托方法。

- (void)connection:(NSURLConnection *)connection didReceiveResponse:(NSURLResponse *)response {
    [self.client URLProtocol:self didReceiveResponse:response cacheStoragePolicy:NSURLCacheStorageNotAllowed];
}

- (void)connection:(NSURLConnection *)connection didReceiveData:(NSData *)data {
    [self.client URLProtocol:self didLoadData:data];
}

- (void)connectionDidFinishLoading:(NSURLConnection *)connection {
    [self.client URLProtocolDidFinishLoading:self];
}

- (void)connection:(NSURLConnection *)connection didFailWithError:(NSError *)error {
    [self.client URLProtocol:self didFailWithError:error];
}

- (void)connection:(NSURLConnection *)connection didReceiveResponse:(NSURLResponse *)response {

[self.client URLProtocol:self didReceiveResponse:response cacheStoragePolicy:NSURLCacheStorageNotAllowed];

}

- (void)connection:(NSURLConnection *)connection didReceiveData:(NSData *)data {

[self.client URLProtocol:self didLoadData:data];

}

- (void)connectionDidFinishLoading:(NSURLConnection *)connection {

[self.client URLProtocolDidFinishLoading:self];

}

- (void)connection:(NSURLConnection *)connection didFailWithError:(NSError *)error {

[self.client URLProtocol:self didFailWithError:error];

}

至此，通过NSURLProtocol和QNDnsManager(七牛DNS解析开源库)可以解决DNS劫持问题。但是NSURLProtocol还有更多的用途，以下是本文第二个内容：webView上web请求的资源本地化。

Web资源本地化

这里只举一个简单的示例，同样是在上述NSURLProtocol的子类的-startLoading方法里

- (void)startLoading {
    NSMutableURLRequest *mutableReqeust = [[self request] mutableCopy];
    // 处理MIME type
    NSString *mimeType = nil;
    mutableReqeust = [self.class replaceLocalSource:mutableReqeust];
    NSString *pathComponent = mutableReqeust.URL.absoluteString.lastPathComponent;
    if ([pathComponent hasSuffix:@"js"]) {
        mimeType = @"text/javascript";
    } else if ([pathComponent hasSuffix:@"css"]) {
        mimeType = @"text/css";
    }
    
    if (mimeType) {
        NSData *data = [NSData dataWithContentsOfFile:mutableReqeust.URL.absoluteString];
        
        NSURLResponse *response = [[NSURLResponse alloc] initWithURL:[[self request] URL]
                                                            MIMEType:mimeType
                                               expectedContentLength:[data length]
                                                    textEncodingName:@"UTF8"];
        [[self client] URLProtocol:self didReceiveResponse:response cacheStoragePolicy:NSURLCacheStorageNotAllowed];
        [[self client] URLProtocol:self didLoadData:data];
        [[self client] URLProtocolDidFinishLoading:self];
    }
}
#pragma mark - 判断是否是本地资源
+ (BOOL)canReplaceLocalSource:(NSURLRequest *)request {
    NSString *absoluteString = request.URL.absoluteString;
    for (NSString *localSourceurl in [self localSourceArray]) {
        if ([absoluteString isEqualToString:localSourceurl]) {
            return YES;
        }
    }
    return NO;
}

- (void)startLoading {

NSMutableURLRequest *mutableReqeust = [[self request] mutableCopy];

// 处理MIME type

NSString *mimeType = nil;

mutableReqeust = [self.class replaceLocalSource:mutableReqeust];

NSString *pathComponent = mutableReqeust.URL.absoluteString.lastPathComponent;

if ([pathComponent hasSuffix:@"js"]) {

mimeType = @"text/javascript";

} else if ([pathComponent hasSuffix:@"css"]) {

mimeType = @"text/css";

}

if (mimeType) {

NSData *data = [NSData dataWithContentsOfFile:mutableReqeust.URL.absoluteString];

NSURLResponse *response = [[NSURLResponse alloc] initWithURL:[[self request] URL]

MIMEType:mimeType

expectedContentLength:[data length]

textEncodingName:@"UTF8"];

[[self client] URLProtocol:self didReceiveResponse:response cacheStoragePolicy:NSURLCacheStorageNotAllowed];

[[self client] URLProtocol:self didLoadData:data];

[[self client] URLProtocolDidFinishLoading:self];

}

#pragma mark - 判断是否是本地资源

+ (BOOL)canReplaceLocalSource:(NSURLRequest *)request {

NSString *absoluteString = request.URL.absoluteString;

for (NSString *localSourceurl in [self localSourceArray]) {

if ([absoluteString isEqualToString:localSourceurl]) {

return YES;

}

return NO;

}

继续阅读NSURLProtocol -- DNS劫持和Web资源本地化

OS X EI Capitan curl: (22) The requested URL returned error: 403 [[[!!! BREAKING CHANGE !!!]]] Support for clients that do not support Server Name Indication is temporarily disabled and will be permanently deprecated soon.

最近在OS X EI Capitan系统上执行升级工作的时候，发生错误，内容如下：

$  brew upgrade cmake
==> Upgrading 1 outdated package:
cmake 3.17.3 -> 3.20.3
==> Upgrading cmake 3.17.3 -> 3.20.3 
==> Downloading https://www.bytereef.org/contrib/decimal.diff
Already downloaded: /Users/longsky/Library/Caches/Homebrew/downloads/f60b5004541eb3c87cce87ef3bf94933a2684ab267346afdc45ae1622ffa923a--decimal.diff
==> Downloading https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.t

curl: (22) The requested URL returned error: 403 [[[!!! BREAKING CHANGE !!!]]] Support for clients that do not support Server Name Indication is temporarily disabled and will be permanently deprecated soon. See https://status.python.org/incidents/hzmjhqsdjqgb and ht
Error: Failed to download resource "python@3.9--setuptools"
Download failed: https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.tar.gz

$ brew upgrade cmake

==> Upgrading 1 outdated package:

cmake 3.17.3 -> 3.20.3

==> Upgrading cmake 3.17.3 -> 3.20.3

==> Downloading https://www.bytereef.org/contrib/decimal.diff

Already downloaded: /Users/longsky/Library/Caches/Homebrew/downloads/f60b5004541eb3c87cce87ef3bf94933a2684ab267346afdc45ae1622ffa923a--decimal.diff

==> Downloading https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.t

curl: (22) The requested URL returned error: 403 [[[!!! BREAKING CHANGE !!!]]] Support for clients that do not support Server Name Indication is temporarily disabled and will be permanently deprecated soon. See https://status.python.org/incidents/hzmjhqsdjqgb and ht

Error: Failed to download resource "python@3.9--setuptools"

Download failed: https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.tar.gz

排查了很久，发现是以前为了修复解决macOS系统curl报告https证书不正确(curl: (60) SSL certificate problem: Invalid certificate chain)问题而配置了curl忽略安全配置信息导致的，如下：

$ cat .curlrc 
--insecure

1 2	$ cat .curlrc --insecure

移除这个配置项目即可解决问题。

参考链接

禁止macOS系统产生.DS_Store文件的方法

Mac经常会产生 .DS_Store 的隐藏文件，虽然在 Mac 上看不到，但是有时用了人家的 U 盘或把 U 盘拿到 Windows 系统上用，就会看到。

.DS_Store 是 Mac OS 保存文件夹的自定义属性的隐藏文件，如文件的图标位置或背景色，相当于Windows 的 desktop.ini。

禁止 .DS_Store 生成：
打开 “终端” ，复制黏贴下面的命令，回车执行，重启Mac即可生效。

$ defaults write com.apple.desktopservices DSDontWriteNetworkStores -bool TRUE

1

$ defaults write com.apple.desktopservices DSDontWriteNetworkStores -bool TRUE
恢复 .DS_Store 生成：

$ defaults delete com.apple.desktopservices DSDontWriteNetworkStores

1

$ defaults delete com.apple.desktopservices DSDontWriteNetworkStores

2022年 9月
一	二	三	四	五	六	日
			1	2	3	4
5	6	7	8	9	10	11
12	13	14	15	16	17	18
19	20	21	22	23	24	25
26	27	28	29	30