From owner-freebsd-cloud@freebsd.org Sat Sep 16 20:46:24 2017 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76F26E07CA2 for ; Sat, 16 Sep 2017 20:46:24 +0000 (UTC) (envelope-from raf@rafal.net) Received: from mxout-08.mxes.net (mxout-08.mxes.net [216.86.168.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FEB86374C for ; Sat, 16 Sep 2017 20:46:23 +0000 (UTC) (envelope-from raf@rafal.net) Received: from [192.168.40.37] (unknown [86.40.118.125]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 87B9B509BB; Sat, 16 Sep 2017 16:46:16 -0400 (EDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: AWS CloudWatch Logs Agent From: Rafal Lukawiecki In-Reply-To: <2a296862-8364-9814-d307-971fa9cf62fd@nomadlogic.org> Date: Sat, 16 Sep 2017 21:46:14 +0100 Cc: freebsd-cloud@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <9B84E838-718C-4477-9940-C80A74D8A030@rafal.net> References: <4FFC6F3B-E8A1-49EE-A05A-C6B9B0A615FF@rafal.net> <0100015e3565144c-18dc3e52-fcba-4b30-bf2f-58b99b55562d-000000@email.amazonses.com> <456A3074-08D2-4141-81EF-5CD6B1B53899@rafal.net> <084bd6ad-9ffd-c097-1d46-c8cb41d745ee@nomadlogic.org> <0A93F7FC-5547-4A67-B3D9-BB59027FDAD6@rafal.net> <38BA8CBD-8A74-4705-BB7B-5737C809540D@rafal.net> <2a296862-8364-9814-d307-971fa9cf62fd@nomadlogic.org> To: Pete Wright X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Sep 2017 20:46:24 -0000 > On 31 Aug 2017, at 00:50, Pete Wright wrote: >=20 > lol no prob - although i promise nothing ;^) but hopefully i can = cobble together a proof of concept - i'll keep ya in the loop. >=20 > -p >=20 > --=20 > Pete Wright > pete@nomadlogic.org > @nomadlogicLA >=20 Hi Pete, I was wondering if you had a chance to assess how bad the work of = converting that AWS CloudWatch log collection script would be. Many thanks and regards from Ireland, Rafal -- Rafal Lukawiecki Data Scientist=20 Project Botticelli Ltd= From owner-freebsd-cloud@freebsd.org Sat Sep 16 23:43:58 2017 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DDA0DE10D39 for ; Sat, 16 Sep 2017 23:43:58 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from vps-mail.nomadlogic.org (unknown [IPv6:2607:f2f8:a098::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C33A368037 for ; Sat, 16 Sep 2017 23:43:58 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.26] (cpe-23-242-94-236.socal.res.rr.com [23.242.94.236]) by vps-mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 08add45c TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Sat, 16 Sep 2017 16:43:57 -0700 (PDT) Subject: Re: AWS CloudWatch Logs Agent To: Rafal Lukawiecki Cc: freebsd-cloud@freebsd.org References: <4FFC6F3B-E8A1-49EE-A05A-C6B9B0A615FF@rafal.net> <0100015e3565144c-18dc3e52-fcba-4b30-bf2f-58b99b55562d-000000@email.amazonses.com> <456A3074-08D2-4141-81EF-5CD6B1B53899@rafal.net> <084bd6ad-9ffd-c097-1d46-c8cb41d745ee@nomadlogic.org> <0A93F7FC-5547-4A67-B3D9-BB59027FDAD6@rafal.net> <38BA8CBD-8A74-4705-BB7B-5737C809540D@rafal.net> <2a296862-8364-9814-d307-971fa9cf62fd@nomadlogic.org> <9B84E838-718C-4477-9940-C80A74D8A030@rafal.net> From: Pete Wright Message-ID: <9adf8d45-6343-b37b-ce4f-95ea71deda3d@nomadlogic.org> Date: Sat, 16 Sep 2017 16:43:56 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: <9B84E838-718C-4477-9940-C80A74D8A030@rafal.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Sep 2017 23:43:59 -0000 On 09/16/2017 13:46, Rafal Lukawiecki wrote: >> On 31 Aug 2017, at 00:50, Pete Wright wrote: >> >> lol no prob - although i promise nothing ;^) but hopefully i can cobble together a proof of concept - i'll keep ya in the loop. >> >> -p >> >> -- >> Pete Wright >> pete@nomadlogic.org >> @nomadlogicLA >> > Hi Pete, > > I was wondering if you had a chance to assess how bad the work of converting that AWS CloudWatch log collection script would be. hey there - so i read through the script that's used for linux and it doesn't really seem salvageable tbh.  i did check out the python module that it uses and i didn't see any obvious blockers to wrapping it in a small script and calling it from cron: https://pypi.python.org/pypi/awscli-cwlogs unfortunately this slipped down my priority list but hopefully i can get it setup on my systems in the next month or so.  if you beat me to it i'd love to hear how it goes for you :) Cheers, -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-cloud@freebsd.org Sat Sep 16 23:47:14 2017 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 84023E10FA4 for ; Sat, 16 Sep 2017 23:47:14 +0000 (UTC) (envelope-from raf@rafal.net) Received: from mxout-08.mxes.net (mxout-08.mxes.net [216.86.168.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5C42E68102 for ; Sat, 16 Sep 2017 23:47:14 +0000 (UTC) (envelope-from raf@rafal.net) Received: from edina.glencottage.net (unknown [86.40.118.125]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 89413509B6; Sat, 16 Sep 2017 19:47:12 -0400 (EDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: AWS CloudWatch Logs Agent From: Rafal Lukawiecki In-Reply-To: <9adf8d45-6343-b37b-ce4f-95ea71deda3d@nomadlogic.org> Date: Sun, 17 Sep 2017 00:47:10 +0100 Cc: freebsd-cloud@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <4FFC6F3B-E8A1-49EE-A05A-C6B9B0A615FF@rafal.net> <0100015e3565144c-18dc3e52-fcba-4b30-bf2f-58b99b55562d-000000@email.amazonses.com> <456A3074-08D2-4141-81EF-5CD6B1B53899@rafal.net> <084bd6ad-9ffd-c097-1d46-c8cb41d745ee@nomadlogic.org> <0A93F7FC-5547-4A67-B3D9-BB59027FDAD6@rafal.net> <38BA8CBD-8A74-4705-BB7B-5737C809540D@rafal.net> <2a296862-8364-9814-d307-971fa9cf62fd@nomadlogic.org> <9B84E838-718C-4477-9940-C80A74D8A030@rafal.net> <9adf8d45-6343-b37b-ce4f-95ea71deda3d@nomadlogic.org> To: Pete Wright X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Sep 2017 23:47:14 -0000 Thanks for the suggestion, Pete. I am chasing a deadline with our site = upgrade project and also hitting the conference travelling season, so I = will not be likely to dive into this till late Oct=E2=80=A6 I hope you = beat me to it! :) But if you cannot, *thank you* nonetheless for having = assessed the situation. Thanks, Rafal > On 17 Sep 2017, at 00:43, Pete Wright wrote: >=20 > hey there - so i read through the script that's used for linux and it = doesn't really seem salvageable tbh. i did check out the python module = that it uses and i didn't see any obvious blockers to wrapping it in a = small script and calling it from cron: >=20 > https://pypi.python.org/pypi/awscli-cwlogs >=20 > unfortunately this slipped down my priority list but hopefully i can = get it setup on my systems in the next month or so. if you beat me to = it i'd love to hear how it goes for you :) >=20 > Cheers, > -pete >=20 >=20 >=20 > --=20 > Pete Wright > pete@nomadlogic.org > @nomadlogicLA >=20