Leonardo MLF plug-in SAP CP Cloud Platformの使い方を紹介します。

インストール方法はチュートリアル「Install the Machine Learning foundation plugin for SAP Cloud Platform CLI」を参照ください。

 ヘルプ確認

$ cf sapml help
A command-line interface for interacting with the SAP Leonardo Machine Learning foundation.

Usage:
  cf sapml [command]

Available Commands:
  config       Display or modify configuration
  fs           Interact with training file system
  help         Help about any command
  job          Manage the training jobs
  model        Manage models in model repository
  modelserver  Manage model servers
  resourceplan List the available resource plans.
  retraining   Retraining Service
  version      Print the client version information

Flags:
  -h, --help       Display Cloud Foundry help.
  -i, --insecure   Disable SSL certificate verification. Not recommended!
  -v, --verbose    Enable verbose output.

バージョン確認

cf cliとplug-nのバージョン確認

$ cf version
cf version 6.46.1+4934877ec.2019-08-23

$ cf sapml version
Client version: 1.1.5
Client commit: 34ecbbab137f58937ef80608428ce8bd0d28a027

fs: ファイル操作関連

fsはファイルシステム操作のコマンドです

fsのオプション一覧

$ cf sapml  help fs
Interact with training file system

The SAP Leonardo Machine Learning foundation provides a remote file system to which
the training, testing, and validation data can be uploaded and trained upon.

The training file system configuration needs to be fetched for the current
instance of the SAP Leonardo Machine Learning foundation. In this process, the training
file system will also be provisioned, in case it has not already. To initialize the training 
file system, please execute 'cf sapml fs init'.

The training file system can be managed via the following sub-commands:
 * init
 * put
 * get
 * delete
 * list
 * config

The training file system is exposed through an Amazon S3 compliant API, whose endpoint
and credentials can get acquired by executing 'cf sapml fs config'. With these 
credentials, any Amazon S3 compatible tool can be used to interact with the training file system.

All files and directories are stored in the 'data' bucket.

For more information about the sub-commands use cf sapml help config <sub-command> 

Examples:
  # Initialize training file system
  cf sapml fs init

  # List top level files and directories
  cf sapml fs list

  # Upload file.txt to sample.txt on the training file system
  cf sapml fs put file.txt sample.txt

  # Download sample.txt from the training file system
  # to the local file file.txt
  cf sapml fs get sample.txt file.txt

  # Delete sample.txt from the training file system
  cf sapml fs delete sample.txt

  # Get training file system endpoint and access credentials
  cf sapml fs config

Usage:
  cf sapml fs [command]

Available Commands:
  config      Show configuration parameters for file system access
  delete      Delete files or directories
  get         Download files for directories
  init        Initialize remote file system
  list        List files and directories
  put         Upload files and directories

list: ファイル/ディレクトリ一覧出力

ファイル/ディレクトリ一覧出力。ファイルサイズや更新日時は出せない。

“r”オプションで全出力

$ cf sapml fs list jobs/
jobs/oilexplr-2019-08-22t0544z486562-e3f57b74-c49f-11e9-969b-eeee0a9a3410/
jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/

# rオプションで全出力
$ cf sapml fs list jobs/ -r
jobs/oilexplr-2019-08-22t0544z486562-e3f57b74-c49f-11e9-969b-eeee0a9a3410/
jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/check_env.py
jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/requirements.txt
jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/sapmljob.yaml

delete: ファイル/ディレクトリ削除

ファイル/ディレクトリを削除。

“f”オプションで確認なし削除。

$ cf sapml fs delete jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/
Are you sure you want to delete "jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/check_env.py" (y/N):y
Are you sure you want to delete "jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/requirements.txt" (y/N):y
Are you sure you want to delete "jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/sapmljob.yaml" (y/N):y
WARNING: All files matching "jobs/with-pip-20190905-0026ac37-cfda-45b9-9774-7bef9b6101c9/" will be deleted.
EOF

# 確認なしオプション
$ cf sapml fs delete -f jobs/with-pip-20190905-1e56ef1e-60b6-40f5-9ed8-93189675e96c/
WARNING: All files matching "jobs/with-pip-20190905-1e56ef1e-60b6-40f5-9ed8-93189675e96c/" will be deleted.

put: ディレクトリ/ファイルアップロード

ディレクトリ/ファイルのアップロード。ファイル名に非ascii文字や半角ブランクは入れないように注意しましょう。

OSによって書き方が違うので例が書かれているヘルプ内容を貼っておきます。

$ cf sapml help fs put
Upload files or directories to the training file system

NOTE: The path separator for the training file system is always /
independent of your operating system.

Examples:
  # Upload tmpdir/file.txt to file.txt on the training file system
  cf sapml fs put file.txt tmpdir/file.txt

  # Windows
  # Upload a file located in the path tmpdir/file.txt to C:\local\file.txt
  cf sapml fs put tmpdir/file.txt C:\local\file.txt

  # Linux/Mac  
  # Upload /local/file.txt to tmpdir/file.txt to on the training file system
  cf sapml fs put /local/file.txt tmpdir/file.txt 

  # Windows
  # Upload C:\local\tmpdir to tmpdir directory on the training file system
  cf sapml fs put C:\local\tmpdir tmpdir/

  # Linux/Mac
  # Upload /local/tmpdir to the tmpdir directory on the training file system
  cf sapml fs put /local/tmpdir/ tmpdir/

put は ファイルをアップロードするコマンドです。そのためでローカルの空ディレクトリをアップロードしようとしても無視されます(Git Pushと同じ)。Training Serviceでログやモデルファイルを置きたい空ディレクトリを作る場合はダミーファイルを置いておきましょう。また、フォルダの中身を全置換するわけではないので、クラウド側に”old.txt”というファイルがあってローカルには”new.txt”というファイルしかないディレクトリをputしてもクラウド側の”old.txt”は消えません。

ローカルの”fax”というディレクトリをルート直下にアップロードしたい場合は以下のコマンドです。2つ目の”fax/”をつけることでルートに”fax”というディレクトリを作成してくれます。

cf sapml fs put fax/ fax/

get: ファイル/ディレクトリのダウンロード

ディレクトリ/ファイルのダウンロード。

OSによって書き方が違うので例が書かれているヘルプ内容を貼っておきます。

“cat”で見られると便利なのですが、ありません。

$ cf sapml help fs get
Download files or directories from the training file system

NOTE: The path separator for the training file system is always /
independent of your operating system.

Examples:
  # Download a file located in the path tmpdir/file.txt to 
  # file.txt in the current directory
  cf sapml fs get tmpdir/file.txt file.txt

  # Windows
  # Download a file located in the path tmpdir/file.txt to C:\local\file.txt
  cf sapml fs get tmpdir/file.txt C:\local\file.txt

  # Linux/Mac  
  # Download a file located in the path tmpdir/file.txt to /local/file.txt
  cf sapml fs get tmpdir/file.txt /local/file.txt

  # Windows
  # Download the tmpdir directory to C:\local\tmpdir
  cf sapml fs get tmpdir/ C:\local\tmpdir

  # Linux/Mac
  # Download the tmpdir directory to /local/tmpdir
  cf sapml fs get tmpdir/ /local/tmpdir

※ 2019/10/1 ひとまずここまでですが、今後追記していきます。