to connect to remote machine from the VSCODE

PHOTO

Mon Aug 22 2022 14:31:01 GMT+0000 (Coordinated Universal Time)

Saved by @irfan309 #apache-spark #vs-code #ssh #ssh-from-vs-code

Host My-Application-Name-or-project-name
    HostName XX.XXX.XXX.XX
    User ubuntu   # user name of machine to login/ssh
    IdentityFile C:\Users\JOHN\.ssh\mykeypair.pem

COPY

this snippet we have to put in .ssh file on local machine to connect to remote machine for development of applications

Save snippets that work from anywhere online with our extensions

Comments

More like this

#apache-spark #spark-submit #--jars #avro #storing-in-avro-format

how to use spark-submit with jars on terminal for storing avro format of data on directory

#when we are storing the data to any directory in AVRO FILE FORMAT, then we have to do some #extra thing that is need to download the jar from the maven like,
# if our spark is 3.0.3 version then we have to search like spark avro 3.0.3 and download the jar file from browser

#spark configuration along with jar setting in our conf
my_conf = SparkConf()
my_conf.set("spark.app.name","write API")
my_conf.set("spark.master","local[*]")
my_conf.set("spark.jars","/Downloads/spark-avro_2.12-3.0.3.jar")


#standard way of creating the df & loading the csv file
order_df = spark.read.format("csv")\
            .option("header",True)\
            .option("inferSchema",True)\
            .option("path","/Downloads/orders.csv")\
            .load()

# writing the data in avro format for that we have to download the jar and configure in sparkConf and the avro file will be stored in below path which is newfolder_data 
order_write_df = order_df.write.format("avro")\
                        .mode("overwrite")\
                        .option("path","/Users/Desktop/newfolder_data")\
                        .save()

#===============================================================================

# now how to submit this jar to process above file on terminal for that,
# on terminal use 'spark-submit' and '--jars' option <path-of-jar-with-jarfile_name.jar> our python_filename.py
#example below
spark-submit --jars C:\Downloads\spark-avro_2.12-3.0.3.jar  Writer_api.py

# done!

#apache-spark #spark-submit #--jars #avro #storing-in-avro-format

How to display human time (x days ago, or now) in django.

Django has a contrib package called "django.contrib.humanize". 
#Add this to your INSTALLED_APPS, 
#then use 
{% load humanize %} 
#in your template, after that,
you can use "value|naturaltime" template tag. "value" will be your date

ref : https://stackoverflow.com/questions/40345450/how-to-display-human-time-x-days-ago-or-now-in-django-admin

#apache-spark #vs-code #ssh #ssh-from-vs-code

to connect to remote machine from the VSCODE

Host My-Application-Name-or-project-name
    HostName XX.XXX.XXX.XX
    User ubuntu   # user name of machine to login/ssh
    IdentityFile C:\Users\JOHN\.ssh\mykeypair.pem

#cloud #ssh

ssh to a server

ssh -i /Users/iliasdh/.ssh/nesk_vision iliasdh@34.125.137.168

#ssh

Create ssh-key

ssh-keygen

#ssh

Deploy ssh key to remote server

# Test key if neccessary
ssh -i ~/.ssh/id_rsa.pub user@hostname

# Copy key over to server
ssh-copy-id [user@]hostname

# You can also just print out the key as dry run
ssh-copy-id -n [user@]hostname

#ssh #server #authentification #network

Copy default public SSH key to remote server

# ssh-copy-id takes care of adding your key in the right place

ssh-copy-id -i "user@hostname.example.com -p2222"

# If you don't use -i all of your public keys will be copied over.
# Also a alias for the host can be used if configured in your ssh config.

# You will be asked for the password and after that all should be taken care of.

#docker #ssh

Connect to Running Docker Container via SSH

docker exec –it <ct-name> /bin/bash

#linux #ssh

ssh to remote machine

#ssh to remote machine.
ssh -i keys.pem ubuntu@xx.xx.xx.xx

#linux #ssh

Send/Copy local file to Remote Machine

#Send/Copy local file to Remote Machine
usage: scp -i <pemfile>  <filename> user-name@domain-or-ip:<path-to-copy>
scp -i .\keys.pem .\<filename> ubuntu@xx.xx.xx.xx:~/  


# copy file from remote machine to local machine (using GIT Bash)
#$scp -i <"pemfile"> user@xx.xx.xx.xx:/<path-of-file-to-copy> <directory-to-paste-file>
#ex:
$ scp -i  "Light.pem"  bitnami@XX.XX.XX.XX:/home/bitnami/AOC_PROJ_UPDATED_08_06_2022/AOC_PROJ_UPD_08_06_22.tar.gz  .

#ubuntu #bash #ssh

Converting .ppk file to private key

puttygen ~/.ssh/my.ppk -O private-openssh -o ~/.ssh/my_openssh.ppk

#ubuntu #bash #ssh

Accessing SSH server using .ppk file

ssh -i mykeypair_openssh.ppk <user>@<host ip>
  
# with port
ssh -i mykeypair_openssh.ppk <user>@<host ip> -P 50055

#ssh #vm #security #server

SSH | Create New Key

undefined

#powershell #ssh

ssh-copy-id equivalent in Windows with PowerShell

type $env:USERPROFILE\.ssh\id_rsa.pub | ssh {IP-ADDRESS-OR-FQDN} "cat >> .ssh/authorized_keys"

#ssh #linux #identity

Create Public/Private key pairs and automate SSH login

#create an identity fil name {mycert} as per your need
ssh-keygen -f ~/.ssh/mycert -t ed25519

#/.ssh/config
Host myserver
Hostname {hostname}
IdentityFile ~/.ssh/{identityFile}
User {username}

#from the console
ssh myserver

to connect to remote machine from the VSCODE

Save snippets that work from anywhere online with our extensions

Comments

More like this

Browse more snippets >>

Embed code snippet