Wednesday, November 21, 2018

Python - How to wait for presence of an element with non empty text?

Hello!

Sometimes it's useful to wait for an element with non empty text. The question is how to do it with Selenium in Python? Pretty easy! You can find an answer below.

If xpath is absolute, then you can wait for your element with non empty text like this:
# xpath - xpath of your element

WebDriverWait(driver, 30).until(lambda driver: driver.find_element_by_xpath(xpath).text.strip() != '')

Tuesday, November 20, 2018

psql: FATAL: Ident authentication failed for user (Centos 7)

What's up?

In this article you will know how to fix this error:
psql: FATAL:  Ident authentication failed for user "username"
which happens when you try to connect as follows:
psql -U username -h 127.0.0.1 -d postgres

How to install/upgrade postgresql server from 9.2 to 9.6 on Centos 7

Hello!

This tutorial includes detailed steps on how to upgrade from old 9.2 postgresql server to new 9.6 postgresql server, with data migration. But you can also use this article if you want to install fresh 9.6 version - you just need to skip migration steps. You can also check this link for more information.

1. install PGDG RPM file for new postgresql server
sudo yum install https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpm
(for the list of all options, check this link: https://yum.postgresql.org/repopackages.php)

Friday, November 9, 2018

How to install latest version of nginx in Centos 7

As of now current nginx version in centos 7 repo is 1.12.2, but latest version of stable nginx is 1.14.1.

In this article we will install latest nginx/1.14.1 in Centos 7.

1. Remove current version of nginx (1.12.2)
sudo yum remove nginx*

Wednesday, November 7, 2018

Running php site with php5-fpm behind nginx (centos 7)

If you're using latest version of nginx nginx-1.14.1-1.el7_4.ngx.x86_64, then by default in /etc/nginx/ you will have this files:

[centos@ip-172-31-37-214 ~]$ ls -la /etc/nginx
total 56
drwxr-xr-x.  3 root root 4096 Nov  7 07:41 .
drwxr-xr-x. 91 root root 8192 Nov  7 07:28 ..
drwxr-xr-x.  2 root root   89 Nov  7 07:37 conf.d
-rw-r--r--.  1 root root 1007 Nov  6 14:04 fastcgi_params
-rw-r--r--.  1 root root 2837 Nov  6 14:04 koi-utf
-rw-r--r--.  1 root root 2223 Nov  6 14:04 koi-win
-rw-r--r--.  1 root root 5170 Nov  6 14:04 mime.types
lrwxrwxrwx.  1 root root   29 Nov  7 07:28 modules -> ../../usr/lib64/nginx/modules
-rw-r--r--.  1 root root  643 Nov  6 13:54 nginx.conf
-rw-r--r--.  1 root root  636 Nov  6 14:04 scgi_params
-rw-r--r--.  1 root root  664 Nov  6 14:04 uwsgi_params
-rw-r--r--.  1 root root 3610 Nov  6 14:04 win-utf

Centos 7: uwsgi.sock failed (13: Permission denied) while connecting to upstream. How to fix.

In centos i had this issue in my nginx error.log:

uwsgi.sock failed (13: Permission denied) while connecting to upstream, client: ...

After searching a bit, I found that this is because of centos SELinux permissions.

Wednesday, October 17, 2018

Druid indexing problem: Offsets out of range with no configured reset policy

I have the following set up:

1) kafka server
2) druid server (historical, broker, coordinator, overlord, middleManager, tranquility, zookeeper)

To get data from kafka I use kafka indexing service (supervisor), which is managed by overlord.

The problem is that recently I started seeing these errors and no data published to dataset:

Saturday, January 6, 2018

How to install python 3.5 in CentOS 7 from source

At the time of writing, repository of Centos 7 contains python 3 of version 3.4, which is not the newest. And sometimes it's useful to have newer version. For example, I needed python 3.5. And here I will show you how to install it. We will be installing it from source.

1. Update repositories and install couple packages:
sudo yum update
sudo yum install zlib-devel openssl-devel