Thursday, 16 July 2020

How to kill all process by command name in Ubuntu?

ps aux | grep python | grep -v "grep python demo.py" | awk '{print $2}' | xargs kill -9

Monday, 6 July 2020

How to transfer dict between python3 and python2?

A better way is to use npy file to transfer dict between python2 and python3, instead of json or pickle.

in python 3:-
np.save('temp.npy', data)

in python2:-
data = np.load('temp.npy',allow_pickle='TRUE').item()

(note that python 2 must upgrade numpy to latest version)

Friday, 3 July 2020

Thursday, 2 July 2020

How to freeze the pytorch network parameters from training?

The basic idea is that all models have a function model.children() which returns it’s layers. Within each layer, there are parameters (or weights), which can be obtained using .param() on any children (i.e. layer). Now, every parameter has an attribute called requires_grad which is by default True. True means it will be backpropagrated and hence to freeze a layer you need to set requires_grad to False for all parameters of a layer. This can be done like this -

model_ft = models.resnet50(pretrained=True)
ct = 0
for child in model_ft.children():
    ct += 1
    if ct < 7:
        for param in child.parameters():
            param.requires_grad = False
 
This freezes layers 1-6 in the total 10 layers of Resnet50. Hope this helps!

p/s: https://discuss.pytorch.org/t/how-the-pytorch-freeze-network-in-some-layers-only-the-rest-of-the-training/7088/2

Wednesday, 24 June 2020

How to enable mandarin or Chinese characters or GBK supported in Ubuntu Sublime?

p/s: copied from https://github.com/seanliang/Codecs33/tree/linux-x64

Description (中文说明见README.zh_CN.md)

Due to the limitation of embedded Python with Sublime Text 3, ConvertToUTF8 might not work properly. You can install this plugin to solve the problem.



Installation
Using Package Control to find, install and upgrade Codecs33 is the recommended method to install this plug-in.
Otherwise, you can download this repository as a zip file from one of the branchs (osx, linux-x64, linux-x32) which matchs your platform. Unzip the archive and rename the new folder to Codecs33, then move this folder to Packages folder of Sublime Text (You can find the Packages folder by clicking "Preferences > Browse Packages" menu entry in Sublime Text).

Tuesday, 23 June 2020